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EXECUTIVE SUMMARY 

This experiment Is part of a project that was Initiated In response 
to a growing concern about the usability of DSN operational software* The 
level of complaints that the software was hard to use Indicated that some 
act ton was necessary to make the software "easier to use"* The goal of this 
project was to Increase understanding of the dynamics of the Man Computer 
Interface (MCI) so that It could be designed to be easier to use* 

The project plan was to hold focus groups to Identify the factors 
Influencing the "ease of use" characteristics of software and to bound the 
problem. A questionnaire survey was conducted to evaluate those factors 
which were more appropriately measured with that method. The performance 
oriented factors were analysed and relationships hypothesized. The hypotheses 
were put to test In the experimental phase of the project. 

The specific factors Influencing the operation of the MCI were 
suggested to be: dialogue control , alternative displays, task/coomand compat- 
ibility, task complexity, command stucture and documentation organization. 
The dialogue control Issue Is whether the operator controls the MCI dialogue 
or the computer system controls the dialogue. The alternative display Issue 
Is whether the computer system displays the alternatives available to the 
operator or not. The task/command compatibility Is whether the command 
arguments are In the same order as the task parameters or not. Task complexity 
Is the mental work required to accomplish the task. Command structure relates 
to the decision tree which the command structure forces the operator to use, 
l.e., wide and shallow or deep and narrow. The documentation organization 
Issue Is whether the comnand listings are presented In a functional order 
(that Is related to the functioning of the system) or not. In addition the 
experiment attempts to measure several operator characteristics to be used 
as mediating variables to reduce the effects of differential operator skills 
and abilities. Typing skill, spatial ability and analytic ability tests 
were administered to the experimental operators. 

The experiment Involved use of a simulated computer system In 
which system and task oriented variables were controlled. Skills and ability 
tests were administrated through the same computer system used In the per- 
formance tests. The experimental operators were given a sequence of con- 
trolled tasks and asked to accomplish those tasks with a comnand format 
which was randomly assigned to them. They used the same format through the 
experiment. Their Inputs and performances times were recorded for analysis. 
One-hundred six experimental operators completed the experiment and provided 
the data for the following conclusions. 

It was hypothesized that a computer controlled dialogue provides 
better performance for Inexperienced operators and operator controlled dia- 
logue provides better performance for experienced operators. The performance 
data Indicate that this relationship varies with the task complexity. For 
simple tasks there was essentially no differential effect between command 
formats (l.e., the dialogue control direction was not Important). Ulth 
Inexperienced operators the computer controlled dialogue did Indeed give 
( somewhat better performance for complex tasks. The experienced operator 
part of the hypotheses was not supported. It appears that the experiment 
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did not run long enough to expose this effect. Other research has found 
that operator preference for operator controlled dialogue develop between 25 
to 80 hours on a system. 

A strong effect was found In the command structure Issue hypoth- 
esis. The wide shallow decision tree formats required considerably longer 
time than the narrow deep decision tree formats. 

The data Illustrated that the documentation style of the operators 
manual has a strong effect on the performance time and on the operators 
attitude. Operation manuals with commands grouped together functionally 
supported better performance than manuals with commands listed alphabetically. 

The experimental operators liked the menu format the most and the 
short form mnemonic the least. They felt that the menu format was the most 
friendly. The prompt and menu fonnats were the easiest to learn with the 
short form mnemonic the hardest. 

A cursory examination of the relationships between the ability 
variables with the performance time variable Indicate that the spatial and 
analytic ability variables do not have any significant correlations. Pos- 
sible explanations are that the tasks may not have truly measured the 
'specific abilities. It may be due to an artifact of the analysis, or most 
likely there Is In fact no relationship. Some format differential correl- 
ations are expected between the typing skills and the performance. However, 
the observed correlations are Inconclusive and no clear statement can be 
made about the population relationship. Further data refinement and data 
analysis may bring out more Interesting results. 

In summary, the initial analysis Indicates that: 

1. There Is an Initial performance effect favoring computer controlled 
dialogue but the advantage fades fast as operators become experienced. 

2. The user documentation style has a significant effect on performance. 

3. The menu and prompt command formats are prefered by Inexperienced 
operators. 

4. The short form mnemonic is least favored. 

5. There Is no clear best command format but the short form mnemonic is 
clearly the worst. 
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INTRODUCTION 
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The consideration of Hunan Factors In the design of command and 
control systems Is becoming Increasingly Important. Systems are becoming 
Increasingly more complex* and more functions are being loaded onto 
systems operators. Both of these factors lead to potential operator dif- 
ficulties. Human factors Is the analysis of the way In which human 
operator characteristics Interact with the system characteristics. An 
understanding of human characteristics allows the system designer to 
design the system to match those human characteristics. Neglecting 
human, factors In system design leads to mismatched systems with reduced 
operator satisfaction and Increased turnover* decreased performance, 
and Increased risk of operator errors. 

Although desirable* Including human factors In system design 
Is difficult for several reasons. The normal engineering curriculum does 
not train the designer In human factors. Typically* a designer's experl* 
ence does not prepare him to Include human factors In his design. In 
addition* human factors specialists are In very short supply. There are 
no recognized academic programs In this area. Although tne physiological 
Issues in human factors are well covered by Human Engineering Handbooks, 
the cognitive Issues are not covered very well at all. And It appears 
that the cognitive Issues In the operation of a computer system are more 
Important than the physiological Issues. The human factors literature 
Is either In the form of very specific research published In journals 
not normally available to system designers (nor In language familiar to 
them) or In the form of generalizations which are difficult to use. It 
would be very valuable to have a set of guidelines and specific recomnen- 
datlons to aid the system designer In his efforts. Even more Important 
than specific design guidelines Is a better understanding of the funda- 
mental Issues so that the Han Computer Interface (NCI) design can be 
generalized. 

The Hlsslon Operations Division of the Jet Propulsion Laborato- 
ry* recognizing the need for a better understanding of Human factors 
Issues and desiring specific MCI design guidelines* commissioned the DSN 
Human Factors Project with the University of Southern California. Dr. 
Thomas H. Martin was the principal Investigator and Roy Chafln was the 
research assistant. The project consisted of a series of focus groups 
to Identify the pertinent human factors Issues* a survey to measure 
operator attitude Issues, and an experiment to Investigate performance 
Issues. The focus group and survey activity has been or will be reported 
In separate reports. This report covers primarily the experimental 
activity. 
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2.0 


SCOPE 


• This report covers , the experimental phase of the DSN Human 
Factor Project. The Intent bf this report Is to discuss human factor 
Issues, describe the experiment and present the results, conclusions, and 
recommendations for NCI design. The experimental issues are discussed 
In Section 4.0, and the experimental hypotheses tested In the experiment 
are presented In Section 5.0. The experimental design Is discussed In 
detail In Section 6.0 with the description of the experiment presented 
In Section 7.0. The results of the experiment are presented In Section 
9.0 and their Impllctlons discussed In Section 10.0. Conclusions are 
presented In Section 11.0 and recommendations In Section 12.0. Detailed 
experimental data Is Included In the Appendix together with some sup- 
porting theoretical material and also some specific design recommend- 
ations for the OSN. 
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4.0 


ISSUES 


The principle Issues In man computer Interface design (MCI) are: 
will It work?, and has the best Interface been selected?. These Issues are 
much too broad to discuss meaningfully, so more detailed Issues are needed 
which are more ameanable to measurement and analysis. These Issues were 
determined to be: dialogue control, alternative displays, task/command 
compatibility, task complexity, command structure, and documentation organiz- 
ation. 

Dialogue Control 

Dialogue control refers to the direction of control cf the man 
computer Interface. The computer can control the dialogue or conversely the 
operator can control the dialogue. Menu and prompt command formats are 
examples of computer controlled dialogue and the mnemonic command format Is 
an example of an operator controlled format. The computer controlled dialogue 
Is normally associated with "user friendly” MCI designs, that Is they are 
expected to be easier for the user than operator controlled dialogues. 
However, several authors have observed that after an operator Is thoroughly 
familiar with a menu format he very often becomes very Impatient (1). The 
flexibility of the operator controlled dialogue (mnemonic) allows a knowl- 
edgable operator to save time and effort and go right to the command that he 
knows is needed. 

Alternatives Displayed 

The MCI can be designed to provide the operator with a list of 
alternative inputs or it can be designed so that he must know the alternatives 
himself (or refer to documentation). The menu command format is an example 
of a format which displays the alternatives that the operator has at each step 
in the commanding process. 

Task/Command Compatibility 

The arguments in the command format can be ordered in the same 
order as the task parameters are presented in a task assignment, or they 
can be ordered in a manner entirely unrelated to the task parameter order. 
If the command format is compatible with task structure (that is their para- 
meter/argument orders are the same) then it is expected that the job of the 
operator is easier, he can map the task parameters directly into the command 
arguments. 

Task Complexity 

Task complexity is a measure of the difficulty an individual 
encounters when accomplishing a given task. This is not a very satisfying 
concept because it's measurement depends too much on Individual abilities. 
In order to separate the concept of task complexity from Individual variations 
we can go back to a more fundamental concept that is contained entirely 
within the characteristics of the task Itself. The difficulty in the experi- 
mental tasks is in selecting commands or command elements which accurately 
accomplish the task. All potential commands must be evaluated as to their 
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ability to accomplish the task. A measure of the difficulty then Is the 
number of possible tasks (corresponding to the number of conmands or conmand 
•laments). Also the number of decisions required to accomplish the task 
Influences Its difficulty. A comnand that has nine elements requires ten 
distinct decisions. The first Is the decision as to which command to use, the 
rmulnlng nine are for each of the nine elements. A task with only two 
elements requires three decisions. A task with nine elements requires more 
Information (and more work from the operator) than a task with only two 
elements, so therefore, we can consider the nine element task more complex 
than the two element task. Task complexity Is operationalized by counting 
the number of parameters plus one. 

Command Structure 

Command formats can be designed to use very shallow and wide 
decision trees, very deep and narrow decision trees, or something In between. 
A shallow/wlde decision tree (Figure 4-1) allows the operator make the decision 
In one step but he has to chose from a large number of potential alternatives. 
A deep/narrow decision tree (Figure 4-2) forces the operator to make many 
decisions each from a small number of potential alternatives to reach the 
final decision. 



Shall ow/Wlde 
Decision Tree 
Figure 4-1 


Documentation Organization 



The documentation that the operator uses as an aid can be organized 
so the commands are functionally related or they are not functionally 
related. Functionally related means that commands associated with a specific 
function are grouped together, titled with that function and appropriately 
Indexed. In this experiment, the short form nmemomlc command format was 
divided Into two treatments, one for each of the manual variable states. 
Short Form one provided a manual In which the command descriptions where 
organized functionally. That Is all the ship control conmands were grouped 
together, the radar commands together, etc.. The operator could find the 
specific desired command by matching the system title with the task (ship 
control with ship control) then scanning only that group listing for the 
appropriate command to accomplish the task. The short form two format listed 
all the Individual commands alphabetically. Therefore, the operator had to 
scan the entire list of conmands to find the one that he wanted. 
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Operator Experience 


The concept of operator experience Is operationalized by the number 
of times that the operator has accomplished a task using a specific system. 
For example. It might be the number of times that he has Issued a ship control 
command. It Is assumed that experience reinforces and solidifies the opera- 
tor's Internal model which allows him to accomplish the task easier (l.e., 
better performance). 

Cognitive Simplicity 

Cognitive Simplicity (see Appendix A) Involves those characteristics 
of a process that make it easy to understand. Typically, It refers to aids 
built Into the system which assist the operator In understanding the process. 

Process Simplicity 

Process Simplicity Involves those characteristics of a process that 
make It easy to use, that Is, make easy to accomplish the process. 


5.0 


HYPOTHESES 


h Is easier for the operator when the computer controls the MCI 
dialogue during of an ordered series of commands (for example, the Initialize* 
tlon and the configuration commands of a system). The operator doesn't have 
to remember the order and he doesn't have to be concerned that he will forget 
a command or enter one out of order. However, It Is easier for an operator 
to control the MCI dialogue when simple commands are entered. It Is easier 
because he doesn't have to wait for the computer to present It's prompt or 
menu. Also, It Is more satisfying because he has the feeling that he Is In 
charge. 

HI: Operator performance Is greater when the computer controls the dialogue 
for a series of commands and when the operator controls the dialogue for 
Individual commands. 

We would expect that the performance of an Inexperienced operator 
would be better when the computer controlled the MCI dialogue and It would be 
better for an experienced operator when he controls the MCI dialogue. When 
the operator's knowledge Is low (lacks experience), he must look the conmand 
up In the documentation. Time Is saved when the computer leads him through 
the process, and he doesn't have to look up the conmand. When he Is 
experienced, he knows what to do so he doesn't have to look up the command (1). 

H2: Inexperienced operator performance Is better when the computer controls 

the MCI dialogue. Experienced operator performance Is better when the 
operator controls tne MCI dialogue. 

The performance of an Inexperienced operator Is greater when the 
alternative actions available to him are displayed on the CRT and he does not 
have to refer to the documentation. He selects the next action from the 
list on the display thus saving the time required to search the documentation. 
When he has developed sufficient experience, he knows what to do so he does 
not have to refer to the documentation nor does he need the display. The 
time required to display the list of alternatives Increase the operator's 
response time. Also, the extraneous information Is an annoyance to him (1). 

H3: The performance of an inexperienced operator is greater when alternative 
actions are available to him on the CRT display. And the performance of 
an experienced operator is greater when the alternative actions available 
to him are not displayed. 

We would expect that operators performance would be inversely 
related to the command complexity. Command complexity Is the range of choices 
that the operator has to make in order to complete the command. Also, when the 
command 1$ less complex, the operator can more easily enter the command into 
the system. More importantly, a lower complexity level reduces the operator's 
mental load and reduces the Interactions between decisions, reducing both 
errors and completion time. 


H4: Operator's performance Is inversely related to command complexity. 
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One of the processes required of an operator Is to map the parameters 
of a task Into the arguments of the command. Ue would expect that the 
operator's job would be easier when the command arguments are In the same 
order as the task parameters. That Is, this order Is compatible. When 
they are not compatible extra effort Is required to reorder the task 
parameters. 

H5: Operator performance Is directly related to the compatablllty of the 
task parameter order and the command argument order. 

When an operator has to look up the command 1r. the documentation, 
that look up time Is a part of the performance time. So, the easier It Is to 
look up the command the less time Is required and the better Is the operator 
performance. We would expect that It Is easier to look up a command when the 
decision range Is low, that is there are fewer choices. However, the number 
of commands required to Implement a system depends on both the number of 
function's required to be specified and the structure of the comnand decision 
tree. A shallow/wlde decision tree has a wide decision range, the operator 
has to pick out the command from a list of all the commands. A narrow/deep 
decision tree makes each decision easier (l.e., smaller decision range) but 
more decisions are required. When a shallow/wlde decision tree Is used, then 
an operator can be aided by grouping the coronands Into recognizable groups. 
The operator searches by group then by command reducing the number of discrim- 
inations required. A functional grouping provides compatibility between the 
search process and the task, and we would expect to Increase operator perfor- 
mance. Of course, this applies only to Inexperienced operators because we 
would expect experienced operators to have little need for the documentation. 

HG: Inexperienced operator performance Is better when the documentation Is 

organized so that the commands are In functional groups and Is poorer 
than when It Is organized non- functionally. 
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6.0 


EXPERIMENTAL DESIGN 


The purpose of the experiment Is to test the hypotheses. The exper- 
imental design Includes the subject selection, treatment, and observation 
or measurement. 

Subjects were recruited from the operating DSN station's, DSN 
organizations at JPL and non DSN organizations at JPL. The subjects were 
recruited from a very broad spectrum of job categories, ranging from dedicated 
computer system operators, to secretaries, and to engineers. There was no 
attempt to select subjects according to "ability", all volunteers were accept- 
ed. The randomness of the subject selection process was jeopardized by the 
self selection of the volunteers. The subject base was made up of those who 
were agreeable to going through the experiment* Those that did not want to 
participate were not forced to go through the experiment. Although exami- 
nation of the data suggests that there were a few subjecv who unwillingly 
went through the experiment and did little more than skip through the tests 
without entering any meaningful responses. This data was not Included In 
the analysis. This self selection Is unavoidable and Is Important only If 
there Is a significant difference In the population of agreeable subjects 
versus the non-agreeable subjects. Obviously there Is an attitude or a 
personal ity difference, however, there Is no indication that there Is any 
difference In their performance In accomplishing the experiment tasks. 

The treatments for this experiments are the five specific conmand 
formats used to accomplish the assigned tasks. The treatment selection 
was random. Each subject was assigned one of the conmand formats (treatments) 
according to the output of a random number generator In the program. 

Measurements were taken by the experiment program and were consis- 
tent between subjects. This allows direct comparisons between the aggre- 
gated performance measurements for each conmand format. 

The quality of the experimental design Is directly related to 
the Internal and external valldatltles of the design. Internal validity 
Is concerned with the question: did the experiment measure what we had 

expected it to measure, or are there other Influences which we did not 
anticipate? External validity Is concerned with the question: over what 

population can we assume that the conclusions taken from this experiment 
apply? 

Internal Validity 

Campbell and Stanley (2) suggest eight classes of extraneous 
variables which might produce confounding effects on an experiment. 

1. History is concerned with specific events which occur between first and 
second measurement of experimental designs that have first and second 
measurements. History is not directly applicable to this experiment 
because only one measurement is taken. However, there are potential 
secondary history effects due to specific events changing the character- 
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Istlcs of of the subject population. The data collection was approximate* 
1y four months long. During this period there were no specific Identi- 
fiable events which would be expected to vary the subject population 
characteristics. There were station equipment upgrades and preparations 
for Voyager encounter but these should not have had a significant effect 
.on the operators ability to perform the experiment. 

2. Maturation is the changing of subject characteristics over time due to 
subjects growing older, growing tired, or growing more skillful. Again, 
this is potentially a problem for multiple measurement experimental 
designs but is not appropriate for this one time measurement design. 
The four months data collection span would not be expected to produce 
significant secondary maturation effects. 

3. Testing effects are the Impacts of a subject taking an initial test upon 
subsequent test scores. Since each subject took the test only once, 
this effect is not applicable. There is a possibility that cross refer- 
encing between subject might influence the later tests. That is, one 
subject giving the answers to a later subject would Invalidate the second 
subjects scores. Because this was a field experiment, as compared to a 
controlled environment experiment, this possibility cannot be contro 'ed. 
However, there is no indication that this happened to any significant 
extent. The coordinators monitored the testing to some extent to avoid 
passing on of answers. Also, except for two of the small mediating 
variables tests, the experiment did not lend itself to the sharing of 
answers. 

4. Instrumentation effects are those changes in the calibration of the 
measuring instrument over the period of data collection. We would 
not expect any calibration changes because the measurements are taken by 
by the program and the program was not changed during data collection. 

5. Statistical regression is an artifact of the sampling process when 
groups a. c selected on the basis of their extreme scores. Since the 
subject selection was random, this effect is not applicable. 

6. Biases are due to differential selection of comparison groups. Because the 
assignment of subjects to groups was random, we can ignore this effect. 

7. Experimental mortality is considered by Stanley and Campbell to be subject 
dropouts between the first and second measurements. This consideration 
is inapplicable for this experiment because there is only one measurement 
period. However, there is a mortality factor for subjects who start the 
experiment but do not finish. Since comparison data between comnand 
formats is primarily on data from complettd performance tests this morta- 
lity factor is minimized. The effect of test mortality on the character- 
istics of the subject population is similar to the effect of unwilling 
subjects and Is essentially unknown. Of the subjects who started the 
experiment (161), 130 or 80% started the performance test and 106 or 66% 
completed the entire test (Appendix B). The possible reasons for the 
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non- completion can be subject related such as fatlque, lack of motivation, 
etc., or It can be non-subject related such as running out of station 
time for the experiment (equipment was required for a spacecraft track), 
or equipment falling. 

8. Selection maturation Interaction Is not of concern In this experimental 
design because maturation Itself Is not an Issue. 

External Validity 

External validity Is concerned with the Issue of general Izablllty. 
That Is, can the results of this experiment be Inferred to a larger population. 

In the strictest sense, the conclusions drawn from this experiment 
can only be applied to those individuals that participated completely in the 
tests. However, general Izablllty Is based on the assumption that If every 
member of a population has an equal opportunity to be in the test sample, 
then the test results may be Inferred to the entire population under the 
rules of inferential statistics. The greatest threat to the external validity 
of this experiment Is the unavoidable lack of a truly random subject sample. 
In order to obtain enough samples for statistical power It was necessary to 
accept every volunteer. And of course, those that did not volunteer or 
refused to participate potentially biased the sample. Also, when the 
recruiting was done through specific organizations, there was a tendency to 
recruit those people who could most be spared In the organization's operation. 
The "busiest" people tended to be excluded from the sampling. Because the 
experiment had to be conducted within a volunteer context this potential 
bias must be accepted. However, there Is no indication nor reason to believe 
that the results are adversely affected by this potential bias. 

Another aspect of the external validity issue is that the results 
of this experiment are expected to be applied to future systems. And, of 
course, future operators cannot be Included in the present sampling. Again, 
this Issue can be viewed in terms of the stability of the characteristics of 
the operator population. If the characteristics of future operators do not 
change, then we can readily apply the results of this experiment. But we 
must be careful in the future to scrutized the overall operator population 
characteristics for significant changes which would possibly invalidate 
these results. 
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7.0 


EXPERIMENT DESCRIPTION 


This Is a simulation experiment In which man computer Interface 
(MCI) designs are studied using a Simulated Computer System. The experiment 
consists of 55 separate tasks making up a naval warfare scenerlo. The test 
subject acts as the computer operator of a computer controlled ship. He Is 
provided with orders on his CRT screen to control the ship. He translates 
these orders (or tasks) Into computer commands using the coomand format 
assigned to him. The experiment program records his response, times the 
response, and In some cases provides feedback to him. Two times are recorded, 
the total time required to enter the response and the think time required 
for the operator to decide which command to use. 

Typically, the performance time for different individuals In greater 
than the difference for different treatments. In order to remove some 
of the variance due to Individuals, mediating variables were Included In the 
experimental design. They were Intended to provide more precision In the 
analysis. 


The anticipated mediating variables are typing skill, short term 
memory, spatial ability, and reasoning ability. Typing skill Is operation* 
•allied using a series of typing tests, short term memory ability with a 
short memory test. Spatial ability Is operationalized using a maze traver- 
sal test. Reasoning skill Is operationalized In two ways, using a number 
sequence test and a reasoning game (DUDZAP game). 


This section will describe the experiment and It's elements. Each 
test will be described separately. The test design and rationale will be 
covered. The specific formats will be covered. The data record and the data 
scoring will be presented. 


Performance Test 


The performance test Is the principle element In the experiment. 
The operator Is assigned to one of five possible treatments. The exercise is 
explained In a series of displays. A four task training session Is provided. 
Then 55 tasks are presented sequentially. The operator response time and 
think time are recorded for each task. 

The four available formats are: short form mnemonic, long form 

mnemonic, prompt and menu. 

Short Form Mnemonic 

The short form mnemonic consisted of a three character mnemonic 
with a slash delimiter, and a single following parameter. (For example, 
HDR/276.) 
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The parameter may be either numeric or alphanumeric. The short 
form mnemonic format respresents a very broad and shallow selection tree. 
There are 45 separate mnemonics In this format (see Appendix C). Each task 
requires a sequence of mnemonics to accomplish the complete task. This 
format represents an operator controlled dialogue format. The operator 
originates the operation by selecting a mnemonic comnand and enters a para- 
meter value without any help from the program. 

The short form mnemonic operating sequence Is: the task Is display- 
ed on the CRT In green. A line Is drawn under the task. The operator selects 
the first mnemonic/ parameter pair and enters It Into the keyboard. It Is 
displayed In yellow on the CRT. A carriage return terminates each mnemonic 
command. Subsequent commands are entered until the task has been completed. 
The operator hits the TAB bar to Indicate that he Is finished with this task* 
the next task Is then presented. The total time Is measured from the present- 
ation of the task to the last carriage return. The think time Is the accumu- 
lated time between the presentation of the task and typing the first character 
of the first command and also the time between each carriage return and the 
next typed character. 

Long Form Mnemonic 


The long form mnemonic also represents that class of commands 
which are operator controlled dialogues and do not present the operator with 
available alternatives. It Is different from the short form mnemonic In 
that there Is a smaller mnemonic list from which to choose. And each mnemonic 
format contains multiple arguments (For example SHIP/276,10)* 

This format represents a deeper more narrow decision tree than the 
short form mnemonic. One long form mnemonic command contains all the arguments 
necessary to accomplish a given task. 

The long form mnemonic operating sequence is the same as the short 
form sequence except that only one command Is entered. The task Is displayed 
In green with a separating line, the operator enters the appropriate command 
with arguments and terminates it with a carriage return. He hits the TAB bar 
to go to the next task. 

All keystrokes are recorded. The total time Is the time between 
when the task Is displayed and when the carriage return key Is hit. The think 
time Is the time between the task display and the first typed character. 

Prompt 


The prompt command format represents the class of commands in 
which the computer controls the dialogue without giving the operator a list 
of alternative inputs. The task Is accomplished by the program asking the 
operator questions. 

The scenario starts the same for all formats. The task Is displayed 
In green with a separating line. The prompt format presents the operator with 
the first question. It asks for the operator to select and enter the ship's 
system needed to accomplish the task. The first character of the Input is 
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unique for each ship's system. It Is used to select the subsequent prompts. 
The remaining prompts In a selected system are fixed In sequence. See Appendix 
C for the list of prompts. Each Input Is terminated with a carriage return. 

the program records the operators response, the total time and the 
think time. The total time Is the time between the task display and the last 
carriage return. The think time Is recorded for each Input. It Is the time 
between the prompt display and the first entered character. The scoring routine 
accumulates the Individual prompt think time and calculates a total think time 
for the task. 

Menu 


The menu command format represents that class of formats for which 
the computer not only controls the dialogue but also provides the operator a 
list of alternatives from which to select. 

The scenario starts the same. The task Is displayed then the first 
menu. The first menu 1$ the system menu. Each menu selection In the sequence 
determines the next menu to be displayed. 

Numerical data (such as ship heading) falls back to the prompt mode, 
with the program asking for specific data. The operator has the option at 
each level, except with the prompted requests, to go back to the previous menu 
or back to the first (system) menu. Each Input Is terminated with carriage 
return, and the operator hits the TAB bar to go to the next task. 

Each menu Identifier code Is recorded along with the operators response. The 
time and the think time Is recorded for each menu. The total time for the 
task Is also recorded. The task total time Is from the time the task Is dis- 
played until the last carriage return. The think time for each menu Is the 
time between the display of the menu and the time the first character of the 
respone Is entered. The scoring routine aggregates the individual think times 
Into a total task think time. 


Treatment Selection 

The experiment program randomly assigns a specific command format 
(or treatment) to each experimental operator. The random assignment was obtain- 
ed from a random number generator. The random number generator Is a 17 bit 
pseudo random shift register generator giving a sequence length of 2*7-1 
words. The starting seed Is obtained from the time of day at the Initialization 
of the program. Subsequent calls to the random number generator advance the 
shift register once. The output of the random number generator 1$ a 16 bit 
word, with a numerical value from -16,383 to 16,383. 

The 16 bit word Is converted to a modulo 8 number (1-8). “1" selects 
the short form mnemonic format (SF1), with the functionally organized manual. 
"2" selects the short form mnemonic format (SF2), with the alphabetically 
organized manual. M 3" and "4‘' select the long form mnemonic form (LF). "5" 
and "6 N select the prompted format. And "7" and "8" select the menu format. 
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Semantic Differential 


At the end of the performance test the operator Is given a set of 
semantic differential scales to measure his attitude towards the command 
format used In the performance test. (See Appendix D). The semantic differ- 
ential measures the operator's attitude on a specific concept by asking him 
to rate that concept on a scale anchored on the extremes by bipolar adjectives. 
For example. 


Old you like the command format? 
LIKED 1:2: 3:4: 5: 6: 7 DISLIKED 


Task Description 

The 55 tasks of this experiment are presented within the context 
of a naval warfare scenario. The experimental operator Is the ship's computer 
operator. His task Is to translate the captain's comnand (l.e., tasks) Into 
the correct computer commands and enter them Into the simulated system through 
the keyboard. 

There are five basic ship's systems: 1) ship control system that 
provides heading and speed commands for manual control, 2) navigation system 
that establishes the destination for automatic control, 3) propulsion system 
to control the ship's boilers, 4) the radar system to control the ship's 
radar equipment, 5) the fire control system to control the ship's weapons 
systems. The fire control system Is further subdivided Into cannon, machine 
gun, torpedo, and depth charge control weapons systems. 

Training 


Before the operator is presented with the 55 tasks he Is given a 
training session which consists of an explanation of the naval warfare 
scenario, and the command format which was assigned to him. These are dis- 
played on the CRT. He Is given an example of a typical task and the proper 
response on the CRT. All format tests use the same task example with the 
response appropriate to the assigned command format. He Is then given a 
series of four training tasks. He enters his response to the task terminating 
his response by depressing the TAB bar. The program displays the correct 
responses In blue below his response, except for the prompt mode which displays 
the direct response for each prompt after that prompt response. 

Manual 


Each operator Is given an operator's manual by the test coordinator 
at the beginning of the experiment. Each comnand format has Its own manual. 
At the beginning of the performance test, the operator Is asked to enter a 
number contained within a box on a specific page. If the entered number 
does not match the expected number for the assigned command format the program 
pauses until the coordinator supplies the operator with the correct manual 
and the correct number Is entered. The manual describes the ship's five 
systems Identically In all format manuals. Each comnand In the format is 
described with Its arguments, their ranges and all limitations. 
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There are two different short form mnemonic manuals In order to provide a 
treatment for the for the experiment. The short form one (SF1) manual 
organizes the list of mnemonics In a functional manner. That 1$ they are 
grouped by the ship's system with which they are associated. The short form 
two (SF2) manual organizes the mnemonics alphabetically. 

Complexity 

The amount of complexity In the tasks Is varied In order to observe 
the effect of complexity on performance. The complexity Is measured by the 
number of decisions an operator has to make to accomplish a task. There Is 
three levels of task complexity, low as exampllfled by the ship control 
system task (3), medium as In the propulsion control system (5), and high as 
In the radar control system (9). 

Compatibility 

The tasks are displayed with the task parameters either In the 
same order as expected In the conmand argument list or out of order. 

Descriptiveness 

The descriptiveness of the task wording was varied to observe any 
effect on the performance. High descriptiveness provides wording establishing 
the context for the numerical task parameter, (for example, "Set the boiler 
pressure to 100 PSI"). Low descriptiveness leaves out the verbal context 
and provides only the parameter value with Identifying units (for example, 
"100 PSI"). 

Completeness 

A few of the tasks ask for only a single parameter Instead of the 
set of parameters normally associated with the conmand. For example, a 
partial task will ask for only a change In ship's heading rather changes In 
both the heading and speed. Or, only the radar power level Is adjusted 
Instead of all the radar parameters. 

Ability Tests 

It Is characteristic of this kind of experiment that differences 
between Individuals are greater than differences between treatments. It Is 
desirable to measure Individual characteristics which may be used as mediating 
variables In the multivariate regression analysis. The variance due to these 
mediating variables is removed In the analysis leaving the remaining variance 
due to the treatment difference. The specific skills chosen as potentially 
Influencing the operator performance are: typing skill, spatial ability, 

analytic ability, and short term memory. 
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Typing Skill 


* 


Typing skill Is measured by giving the operator a page of text 
and measuring the time required by him to enter It Into the keyboard. 
Also, separately each keystroke Is recorded In order to obtain an error 
count. The typing test for this experiment was divided Into four parts each 
emphasizing different typing characteristics. The first part was a page of 
practice characters. Every keyboard character was presented to the operator 
for practice. So that In the following typing tests, the character locations 
would not be completely new. This was felt to be required because of the wide 
range of typing skills and experiences. Some operators were accustomed to 
other keyboards with some different character locations, and some were not 
familiar with any keyboard. The second part of the typing test was one page 
of text taken from a standard typing test. It was English text telling a 
short story. The story required 6 pages of display. This was much too long 
for the expected operator typing skills, so only the first page was typed. 
The remaining pages were presented to the operator so that he could finish the 
story. These remaining five pages were the third part of the test. It Is not 
a typing test but a reading test. Randomly, the five pages were displayed In 
either all caps or mixed mode lower case with appropriate capitalization 
(normal English test). The reading time Is measured to provide a compar- 
ison between the two display modes. 

The fourth typing test Is a random character test. Three lines of 
random characters are displayed In groups of 3 characters for first page, 5 
characters for the second, 7 for the next and 9 for the next. The preceding 
character groups consist exclusively of upper case alphabetic characters. The 
last page consists of 5 random characters per group taken from the entire 
range of printable ASCII characters. This test was to study the relation 
between group length and performance. 

Spatial Ability 

Spatial ability hopefully Is measured with a series of mazes. 
The maze is displayed on the screen and the operator manuevers the cursor 
through the maze using the cursor control keys. He Is looking at the maze 
from a position above so he can visualize the entire maze. The path taken 
through the maze Is selected by the operator. His success In traversing the 
maze Is expected to be related to his spatial ability. The total time to 
traverse the maze Is recorded. Also each st^p and the time taken to make that 
step Is recorded. The scoring routine scores the total time for one variable 
and the first step time for a second variable. The rationale for the first 
step time variable Is that It was observed in the pilot testing that often 
the operator would traverse the maze visually before moving the cursor for 
the first time. The maze test consisted of seven mazes presented in order of 
Increasing difficulty. The first five mazes were adapted from the Porteus 
Haze tests. (3) These first five mazes were Intended for ages up to 10, so 
two more difficult mazes were created to hopefully increase the test variance. 
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Analytic Skills 


Two analytic games are used In the experiment* The first Is a 
mathematical sequence game. A sequence of five numbers Is presented and the 
operator determine the next number In sequence. There were ten sequences 
generally ordered In terms of Increasing difficulty. The sequences are 
shown In Appendix E together with their weighting scale. The scoring routine 
assigned greater weight to the sequences which are deemed to be more difficult. 
After the operator entered his estimate of the next number In sequence, the 
program either output "OK" for a correct Input or output the correct answer 
In blue for an Incorrect Input. 

The second game Is called OUOZAP. It Is Included In the experiment 
as an attempt to tie this research data with previous research (4,5). The 
operator was presented with a series of six bit words. After the 6 bit 
words the program adds the word "ZAP" If the 6 bit word corresponds to a 
rule that the program knows but the operator doesn't. The rule Is restricted 
to the logical OR combination of two of the six bits. If the word does not 
correspond to the rule, 0U0 Is added to the word. The object of the game Is 
for the operator to guess the rule from the given sequence of six bit words. 
The scores are obtained from the number of words displayed before the operator 
determines the correct rule and from the number of guesses made before the 
.correct rule Is determined. Four games were played with the final score 
aggregated from the separate games. 

Short Term Memory 

The short term memory test was modified for the computer experiment 
from standard short term memory tests (6,7,8). A series of five groups of 
randomly selected characters are displayed to the operator for 2 seconds. 
He Is distracted for 5 seconds so that he does not rehearse the characters. 
Then he Is asked to type in the characters. The number of characters In the 
group Is Increased from 3, to 5, to 7, and to 9. In order to distract the 
operator during the 5 seconds In the standard tests the subject Is asked to 
count backwards by 3's The computer cannot monitor that activity so another 
approach was taken. A witty saying was displayed for the 5 seconds, hoping 
to distract the operator. 


Demographic Questionnaire 

Each operator Is asked for his birth date. This Information Is 
Intended to be used to tie the experimental data with the previous survey 
data. Age Is derived from the year of birth. It Is available as a mediating 
variable. Three questions cover the operator's job catagory and specific 
experience (see Appendix F). These questions provide a basis for stratifying 
the sample for specific analyses. The first question establishes the operator 
environment. The categories are: station operating crew, station staff, 
net control operations, other DSN personnel and other non DSN personnel. The 
second question establishes the operators Individual job catagory. The op- 
tions are: operator, clerical, technician, engineer, programmer, supervisor, 
manager, and other. The third question establishes the operator's experience 
level for megadata terminals and for terminals In general. Another series 
of three questions attempt to measure characteristics relating to cognitive 
style (9). Preference for complexity Is measured along with preference for 
structure and preference for variety. 
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RESULTS 


The experimental results will be explored In this section. First 
the Individual random format assignments will be considered* then the Individ- 
ual mediating variables* the performance test and finally the Interrelation- 
ships will be considered. 


Format Assignment 


The command format used by each subject was selected by a random 
number generator. It Is of Interested to see If the random assignment was 
consistent throughout the experiment. The data records Indicate that the 
experiment program was loaded 381 times. One hundred nlnty four (194) starts 
of the experiment were recorded. Therefore* there were 193 loads which did 
not result In an experiment start. This can be due to several reasons. The 
subject nimber Is Incremented at each program load but the load Is only 
recorded trfien the station ID Is entered. So* a program load to check the 
equipment would not register If the station ID Is not entered. Also* the 
station coordinator has the option of starting the program In the TEST mode 
which Is recorded but Is not reflected In the 194 experiment starts. The 
reasons for one half of the program starts falling to produce an experiment 
start Is due to equipment checks and test mode runs* neither of which should 
affect the statistical frequency of formal selections. 


The first meaningful measure of the frequencies of the random 
form&i selection Is for program starts In the experiment mode and with the 
station ID entered. There were 194 of these program starts with frequencies 
listed In Table 8-1. 


FORMAT 


PROGRAM STARTS IN EXPERIMENT EXPERIMENT EXPECTED 

IN EXPERIMENT MODE STARTS COMPLETIONS FREQUENCIES 


Short form mnemonic #1 
Short form mnemonic #2 
Long form mnemonic 
Prompt 
Menu 

Totals 


( 8 . 8 %) 
(10.3%) 
(28.8%) 
(31.0%) 
41 (21.1%) 

1'94 (TOO. 04) 


17 

20 

56 

60 


16 (10.0%) 13 (12.2%) 

17 (10.5%) 7 ( 6.6%) 

43 (26.7%) 30 (28.3%) 

49 (30.4%) 34 (32.0%) 

36 (22.3%) 22 (20.7%) 

ltfTfTflfcw) WHlSfcw) 


12.5% 

12.5% 

25.0% 

25.0% 

25.0% 

T0O% 


Table 8-1 


Each percentage value Is the percentage for that format of the total remaining 
at that stage of the experiment. The experiment starts when the questlonalre 
has been completed. There Is a fallout of 33 cases between the program start 
In the experiment mode and the actual experiment start. Again* these are 
expected to be equipment tests and are not legitimate experiments. The 
legltmate experiment starts are 161 cases. The frequencies (percentages) 
Indicate that the short form mnemonic frequencies are close to the expected 
frequencies (10.0% vs. 12.5% and 10.5% vs. 12.5%). The discrepancy from the 
expected random frequency (12.5%) appears to be nominal. The long form 
mnemonic frequency 1$ close to expectation (26.7% vs. 25%). The prompt 
format frequency Is overrepresented (30.4% vs. 25%) but there Is no reasonable 
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format related explanation so It should be accepted. The menu format frequnecy 
Is slightly underrepresented (22.3X vs. 25X) • 

The column labeled as Experiment Completion contains frequencies 
of the experiment session which were carried to completion by the individual 
subjects. The total of 106 completed cases Indicates that S5 subjects started 
the -experiment but did not finish. The dropouts could be related to format 
effects, subject effects and/or external effects. Subject effects were not 
Investigated and would be a good candidate for further investigations. The 
external effects are such things as termination of the session due to station 
demands for the equipment. The frequencies of all the formats except short 
form mnemonic 2 are reasonable and can be assumed to be random. The frequency 
for short form mnemonic 2 format Is considerable underrepresented. This 1$ 
most likely a format effect and Is discussed In detail In the section on doc- 
ument organization. 


Mediating Variable s 

The mediating variables were scored Individually. They are presented 
by specific test In this section. 


Demographics 

The first series of questions that are presented to the operator 
deal mainly with factors which may Influence the results. The first variable 
Is the operator's age. The average age Is 34.5 for 89 experimental operators. 
The 1 sigma value was 10.3 years. The histogram of the age variable Indicates 
that this Is a good spread In age (range from 18 to 69). All ages are reason- 
ably represented and the distribution Is reasonable for a population of computer 
system operators. 

The second demographic variable concerns the operator's organizational 
position. The choices were: 

1. Station operating crew 

2. Station staff (non operations) 

3. Net control operations 

4. Other non station DSN personnel 

5. Other non DSN personnel 

Forty-three percent reported that they were on the station operating crew 
with 37X reporting that they were non station DSN personnel. The remaining 
20X were fairly equally distributed between the remaining categories. 

The next demographic variable Is concerned with the operator's job 
classification. The choices were: 

1. Operations 

2. Clerical 

3. Technician 

4. Engineer 

5. Programmer 

6. Supervisor 

7. Manager 

8. Other 
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Thirty percent reported that they are In operations, 17% technician, 13% each 
for engineers and programmers. 

The last demographic variable attempts to obtain a general experience 
level by measuring the operator's computer terminal usage* The categories are: 

1* Use Megadata terminal routinely 
2* Use Megadata terminal occasionally 
3* Use other computer terminals routinely 
4* Use other computer terminals occasionally 
5. Use word processor primarily 
6* Do not use any computer terminals 
7* None of the categories fit 

The variable values were fairly evenly distributed except for the word processor 
category and the none category* We can expect that most of the 23% who reported 
using the Megadata terminals routine are station operators* Twenty percent 
reported that they used other computer terminals regularly, and 13% used them 
occasionally* These are either operators In other systems (1*e*, NOC Ops) or 
people are knowledgeable because :hey use Interactive terminals* Twenty percent 
reported that they did not use any computer terminals. 

Cognitive Style Variables 

The next three questions relate to cognltve style. Cognitive Style 
1$ a method separating people Into a limited set of groups based on their 
Information processing habits. Knowledge of cognitive style allows prediction 
of some characteristics. The Driver-Mock cognitive style model (9) Is used In 
this analysis. The Driver-Mock model Is a two dimensional model In which one 
dimension Is related to preference for structure and the other Is related to 
preference for complexity. One style question asks the experiment operator 
for his preference for structure. The other two are related, one asks for 
preference for complexity and the other preference for variety. Each use a 
seven point scale with end points of highly structured/ highly unstructured, 
very simple/very complex, variety of tasks/consistent tasks. 

The preference for structure has a mean of 4.55 on scale of 1 to 7 
with "1" meaning a preference for structure. The histogram for this variable 
Is bimodel, that Is, there are two groups, one with a large preference for 
moderate to little structure and a small group preferlng much structure. 

The mean for the complex preference measure Is 5.02, which is dis- 
tinctly balsed towards the preference for complexity, although there Is a 
small Indication of a second group which prefers simplicity. 

The mean for the variety preference Is 2.07 which Is strongly 
balsed towards the preference for a variety of tasks. It does not Indicate 
any blmodal tendency. This variable reinforces the Indicated preference 
for complexity. 
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These variables Indicate that this population would not feel com- 
fortable and would not care for a very structured procedural 1y oriented 
operating envlrorment. 

However, It should be recognized that these three variable are 
potentially affected by some strong cultural effects* For example, preference 
for complexity has some cultural connotation of Intelligence, and therefore 
Is more desirable* Preference for structure and variety have some similar 
connotations, therefore these variables are somewhat suspect* 

Typing Skills 

Individual typing skills were measured by a series of tests. The 
experimental operators training and skills self assessment were measured 
with a questionnaire. General text typing skill was measured. Random char- 
acter code typing skill was measured. Thirty-five percent (35%) of the exper- 
imental operators reported that they used the touch typing method, that Is, 
they use all ten fingers. Thirty- four percent (34%) reported that they used 
the two finger hunt and peck system, and 18% reported that they used the one 
finger hunt and peck system. This data appears reasonable for the experiment 
population. Fifty-nine percent (59%) reported that they had no formal typing 
training, 40% report that they did have formal training. The experimental 
operators self assesment of their typing skill was measured with the question 
"Can you type without looking at the keyboard or do you have to look for the 
characters?". It was measured on a seven point scale with the end points 
"never look" and "always look". Thirty-two percent (32%) reported that they 
always look. The remaining data Is fairly evenly distributed. The mean 1$ 
4.99 reflecting the heavy response on the alway look extreme. This data 
suggests that the majority of the experimental operators were not skilled 
typists. This Is expected and is supported by the experimenter's experience 
In administering the experiment. The most frequent complaint about the 
experiment from the station crews was the large amount of typing Involved. 

The text typing test data had a wide range of from .2 to 1.9 seconds 
per character. The mean was .67 second per character with a standard deviation 
of .30 seconds. The text was one page containing approximately 800 characters. 
The text was taken from a standard typing test and was normal English text. 
There were no nunbers or special characters used. 

The random character tests consisted of five pages of groups of 
approximatly 100 random characters. The first page grouped the characters In 
groups of three alphabetic characters. The next page used groups of 5, the 
next 7, and the fourth page wa^. grouped In groups of 9 characters. The 
fifth page grouped 5 characters together but expanded the character set to 
the entire ASCII set Instead of just alphabetic characters. The 3 character 
pege typing speed mean was *84 sec per characters with a standard deviation 
of .36 sec. There appear to be two distinct groups from the histogram. 
The first one, centering on .40 sec per character. Is assumed to represent 
the trained typist. The typing speeds are presented In Table 8-2. The 
speed Is In seconds per character typed (including spaces). 


TYPING TEST 

MEAN 

STANDARO DEVIATION 

1st GROUP 

2nd GROUP 

Text 

.67 

.36 

.36 

.80 

3 Random Char. Group 

.84 

.36 

.40 

.90 

5 Random Char. Group 

.94 

.41 

.40 

1.05 

7 Random Char. Group 

1.03 

.45 

.40 

1.10 

9 Random Char. Group 

1.09 

.62 

.50 

1.20 

5 Random ASCII Char 
Group 

2.21 

1.05 

•• 

•• 


Typing Speed In Seconds pt. Character 
Table 8-2 


Me can make some Interesting observations from Table 2. 

1. As we might expect, there are distinct differences In typing speeds 
between trained and untrained typists, differences of 1:2 to 1:3. The 
•40 sec per character corresponds to about 25 words per minute. This Is 
fairly slow for a good typist, but a trained typist 1$ not necessarily a 
good typist and the keyboard was unfamiliar to even the good typists. 
So an average of 25 words per minute Is not unreasonable for trained 
typists In this experiment. 

2. Random characters are more difficult to type than English text. This 
supports other findings In the field (10). The difference appears to be 
about a 10% speed penalty for the simplest random character groups over 
English text. 

3. The trained typists' speed for different number of random characters In 

a group Is quite constant. But, It Is clear that the untrained typist 

has an adverse reaction to Increasing the nunber of characters In a 
random group. This 1$ most likely an Interaction with short term memory. 
The trained typist does not use his short term memory. He keeps his 
eyes on the text and types without having to move them to the keyboard. 

The untrained typist (hunt and peck system) must look at the text, use 

his short term memory to store the characters, transfer his attention to 
the keyboard, recall the characters, and type them. The data supports 

the theory that short term memory Is Inversely related to the length of 

the character groups. 

4. The random ASCII character set required more than twice the typing time 
as the equivalent (5 char, group) alphabetic only character set. We 
would expect longer typing time for characters with which the typist 
(trained or untrained) Is not familiar. It Is Interesting to note that 
apparently training Is not an asset for arbrltrary characters. We should 
also note that the less used characters In the ASCII set are not In 
consistent locations on all keyboards. In fact, two of the ASCII char- 
acters were not even on the keyboard used In this experiment. 
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Spatial Ability 


Spatial ability Is measured by a series of mazes. It Is assumed 
that spatial ability Is related to the experimental operators ability to 
"see" the path through the maze. The time required to traverse the maze 
Is measured as spatial ability. There are seven mazes starting with a simple 
one and progressing to more difficult ones. Table 3 gives the maze traverse 
times In seconds. 


MAZE 

MEAN 

STANDARD DEVIATION 

1 

31.4 

16.7 

2 

33.0 

7.9 

3 

32.5 

7.7 

4 

37.8 

16.6 

5 

56.3 

13.6 

6 

105.5 

29.5 

7 

97.8 

43.7 


Maze Traverse Times 
Table 8-3 

The series of increasingly difficult mazes were used in order to give the 
operator practice and so that he could learn the mechanics before he tried 
difficult mazes. The first maze was very simple. Its standard deviation 
indicative of the learning process. By the second maze the standard deviation 
indicates that the operators had essentially mastered the mechanics. The 
fourth maze starts to give an indication of differential effects. The sixth 
maze is in fact the most difficult as indicated by the mean traverse time 
and standard deviation. The seventh maze is somewhat easier as indicated by 
its mean traverse time. The large SD for the seventh maze can perhaps be 
explained by fatigue. Those individuals with high spatial ability will not 
be stressed and will perform well. But those with low spatial ability may 
well be fatigued after the previous hard maze and perform worse than expected. 

Analytic Ability 

Analytic ability was measured using two tests, the number sequence 
task and the OUDZAP game. The number sequence test was scored by summing the 
weighted correct answers over the 10 sequences. The data taken from this test 
is nominal, that is, it has meaning in relationship to other variables or to 
other groups but not in an absolute sense. The mean was 14.04 and the standard 
deviation was 7.28. The histogram indicates a reasonable distribution. So, 
the variable appears to have sufficient variance and proper distribution for 
further regression analysis. 

The DUDZAP game was scored two ways. First by summing over the 
four games the number of displayed words required to determine the logic 
rule and second by summing the number of hypotheses or guesses required to 
determine the logic rule. The mean and standard deviation for the first is 
28.0 and 16.0 and for the second is 17.0 and 10.8. Both variables appear to 
have sufficent variance and distribution to be useful in further regression 
analysis. 


26 


I 


Performance tests 

The results of the performance tests are plotted against specific 
experience In Appendix G« The performance time and think time are plotted 
for each format for each task of each system. The specific systems were 
plotted together to Illustrate the change In performance for Increased exper- 
ience In a consistent situation. Three systems, ship control, propulsion 
control, and radar, will be discussed primarily because they represent low, 
medium, and high task complexities. Also, they will be discussed because 
they were exercised more completely than the other systems and provide a 
more complete picture of the format characteristics. From these plots, the 
following observations can be made. 

Task Complexity 

As is expected, more complex tasks require more time. The simplest 
system was the ship control system. It has a task complexity as defined In 
the Issues section of this report of 3. There are three decisions to be 
made: which system Is being commanded, and the heading and speed. The 
propulsion control system has a complexity of 5 and the radar control system 
of 9. The low complexity ship control system performance time appears to 
approach an asymptote at approximately 20 seconds. The medium complexity 
propulsion control system appears to approach the asymptote at approximately 
30 seconds and the high complexity radar system at 40 seconds. 

Attempts to compare the different systems with the same complexity 
have not been successful. This creates a presumption that the definition 
for complexity Is too simple. Further effort is needed in refining the 
operationalization for complexity. Most likely, including the span of deci- 
sion (or number of choices) would be fruitful. 

Task Complexity vs. Command Complexity 

It is clear that the complexity of the task determines the minimum 
complexity of the command. However, the comnand structure can add complexity. 
This is demonstrated by the ‘ performance time of the short form mnemonic 
format compared to the other formats. In all but the simplest task (ship 
control system) the short form mnemonic format performance times were signif- 
icantly greater than the performance times for the remaining formats. This 
can be explained by examining the decision process. In selecting a command, 
the short form mnemonic format requires a mnemonic command for each parameter. 
Therefore, the entire mnemonic range of 45 mnemonics must be scanned for 
each parameter. The long form mnemonic has fewer mnemonics to scan (8) and 
they have to be scanned only once per task. Of course, the complete deter- 
mination of the command from the mnemonic repertoire and the task parameters 
Is more involved. Further research effort would be valuable In developing a 
more Isomorphic model. It appears that a model based on an analysis of the 
decision processes for each command format may allow numerical complexity 
values to be derived which can be used for consistent comparisons between 
formats. 


The existing comparisons between command formats is based entirely 
on the measured performance times. They do not Include any assesment of 
error patterns. Tne analysis should be continued using the error rates for 
the Individual task responses. 
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Command Format Comparison 


Table 8-4 Is a ranking of the command formats In terms of their 
overall performance times for each of the different experiment systems* with 


a higher number for the longer performance times. 






Format 




System 

SF1 

SF2 

LF 

P 

M 

Ship 

1 

1 

1 

1 

1 

Propulsion 

2 

2 

1 

1 

1 

Radar 

4 

3 

2 

1 

1 

Navigation 

3 

3 

2 

1 

1 

Cannon 

4 

5 

3 

2 

1 

Machine Gun 

2 

2 

1 

1 

1 

Oepth Charge 

2 

3 

1 

1 

1 

Torpedo 

3 

3 

2 

1 

2 


Command Format Performance Ranking 
Table 8-4 


Those rankings were obtained by observations from the performance time plots 
In Appendix 6. 

From Table 8-4 It can be seen that the format differentiation Is 
minimal for low systems complexity. The low complexity ship control system 
performance Is essentially the same for all formats. The medium complexity 
propulsion control system shows differential effects between the short form 
formats and the others. The high complexity radar system shows significant 
differential effects for all but the prompt and menu formats. 

Think Time 

Think time Is plotted on each system performance time plot In 
Appendix 6. The think time Is the time taken by the experimental operator 
to think about the task and decide which command or parameter to use. It Is 
clear from the plots that, except for a very few isolated points, the think 
time follows the shape of the performance time plots very closely. This 
leads to the conclusion that the variance in the performance times are prin- 
cipally due to think time not to execution time. Table 8-5 is a ranking of the 
command formats in terms of the think time for each of the different systems, 
with higher numbers for longer think times. 
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System 

SF1 

Format 

SF2 

IF 

P 

M 

Ship 

2 

2 

1 

3 

3 

Propulsion 

4 

4 

1 

2 

3 

Radar 

3 

3 

1 

2 

3 

Navigation 

4 

5 

1 

2 

3 

Cannon 

3 

4 

1 

2 

2 

Machine Gun 

2 

2 

1 

2 

2 

Depth Charge 

2 

3 

1 

2 

- 


Think Time Ranking 
Table 8-5 


The consistent ranking of one for the long form mnemonic Is an 
artifact of the scoring routine. It did not take Into account the think 
time for each argument, that Is when the operator stopped to think between 
each argument for a coimand. Therefore it Is somewhat lower that It should 
be. Patterns for think time rankings are somewhat more difficult to find 
than for performance times. However, It appears that the prompt and menu 
think times are In general less than for the short form mnemonics. And 
where there Is a difference between the prompt and the menu, the prompt 
appears to have lower think times. The Interaction between differential 
think time and system complexity appears to be very weak. This leads to a 
question about the consistency between the performance times of the long 
form mnemonic, the prompt, and the menu formats when that consistency doesn't 
seem to exist In the think time. This may be an artifact of the specific 
format design, that Is the think time and execution times may cancel out for 
some unknown reason. More analysis and possibly more research is suggested 
In this area. 

Compatibility 

Compatibility Is the slmllarily of the ordering of the task para- 
meters and the conmand arguments. It would be expected that Incompatibility 
would be seen In the Increased times for performance. The variations for 
low complexity ship control performance are so small that compatibility 
difference are difficult to detect. The variations for high complexity radar 
performance are quite large and are consistent over the long form mnemonic, 
prompt, and menu plots, so It will be used to Investigate the effect of incom- 
patibility. The Individual tasks plots Figure 8-1 are labeled either "C" 
for compatible or ,r t" for not compatible. Three out of five longer performance 
times (positive deviations) were associated with Incompatible task present- 
ations. All four shorter performance times (negative deviations) were asso- 
ciated with compatible task presentations. This lends support to the hypoth- 
esis that compatibility between the task presentation and the command format 
improves performance time, at least for the more complex tasks. Additional 
analysis may provide more Insight Into this process. Another way to analyze 
this Issue Is that 3 of the 4 Incompatible tasks have positive deviations 
and 4 of the 6 compatible tasks have negative deviations, again providing 
some support for the hypotheses. 
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Partial Tasks 


At times a task requires only a partial system Input. For example* 
In this experiment there were two tasks that required only the ship's speed 
to be changed Instead of both speed and heading* or only the radar system 
power level was changed rather than all eight parameters. It Is interesting 
to look at how the performance time Is affected by thsse partial tasks for 
the different command formats. Table 8-6 lists the ranking of performance 
time Improvement for the different formats for partial tasks. 


System 

Ship Control (low complexity) 
Radar (high complexity) 


Format 

SF1 SF2 

1 1 

1 1 


LF 

3 

3 


P M 


3 2 

3 2 


Ranking of performance time Improvement 
for partial tasks 

Table 8-6 


As might be expected the short form mnemonic formats show the most Improvement 
for a partial task. In fact they show the best performance for a partial 
task. The short form mnemonic allows a one parameter task to be carried out with 
one mnenonlc command. The other formats must Identify which parameters are 
being changed and which one are not being changed. 

Context Time 


An Interesting phenomenon can be observed In the ship control perform- 
ance time plots (Appendix 6) which Is Important for procedure design and for 
man comouter Interface dialog design. The ship control system performance 
time decreases with experience as expected. However* the last two points show 
a distinct performance time Increase of about 25%. The difference between 
these two points and the preceding points Is that these last two points are 
Isolated tasks, that Is they are Inserted between tasks for other systems. 
The first series of ship control system data points are consecutive tasks. 
Reflection on this observation leads to the definition of another concept. 
This concept can be labelled "context". Context Is the process an operator 
goes through when he approaches a different part of the system. He must Ident- 
ify that part of the system, determine what parameters are associated with It, 
and any limitations on the parameters. It takes time to do this, which we can 
call context time. Therefore a task accomplished within a series of similar 
tasks already has the context developed. A task embedded within dissimilar 
tasks requires restabllshlng the context and requires more time, even for the 
same operator experience level. This phenomenon) Is not observed In the other 
system plots because their data points were either all within one sequence or 
were all Isolated events. 
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Documentation Style 

Documentation style Is concerned with the effects that different 
ways of presenting the user operating manual has on the performance time* 
This variable applied only to the short form mnemonic command format. The 
experimental operators who were assigned the short form mnemonic were randomly 
assigned either the manual organized functionally (SF1) or the manual orga- 
nized alphabetlally (SF2). 

Differential effects are Illustrated In three areas; the performance 
times, the attitude survey, and the differential completion rates for differ- 
ent formats. The performance time profiles for the SF1 and SF2 formats were 
very slmillar. However, in all but one system (navigation) the first attempt 
to use the short form format took longer If the alphabetically organized 
manual was being used. Table 8-7 lists the percentage Increase of SF2 over 
SF1 for each of the experimental systems from the performance time plots of 
Appendix B. 


System 

Navi agat ion 
Propulsion 
Ship control 
Radar 
Cannon 
Machine Gun 
Depth Charge 
Torpedo 


Percentage 

0 

11 % 

205 

75 

325 

245 

805 

85 


Increase of SF2 performance time 
Over SF1 performance for 
First system attempt 

Table 8-7 

Table 8-7 Indicates that the alphabetic organized command list 
takes longer to use at first. The plots Indicate that for the second and 

subsequent uses the user adjusts to the alphabetic order and the performance 
times are essentially the same. 

The results of the post experiment semantic differential survey 

are presented in Appendix H. From this data we can see that: 

1. SF1 commands were liked better than SF2 commands. 

2. SF2 commands were felt to be slower than SF1 commands. 

3. Both SF1 & SF2 were more uncomfortable than the other formats and SF2 
was more uncomfortable than SF1. 

4. SF2 commands were considered to be more complex than SF1 commands. 

5. SF2 commands were felt to be harder to use than SF1 comnands. 

6. SF2 commands were significantly harder to learn than SF1 commands. 
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7. The SF1 command format was felt to be more useful than the SF2 command 
format. 

8. The operators using SF2 had to look up the conmand more often than those 
using SF1 

9. It was felt that the SF1 SOM was easier to use than the SF2 manual. 

The survey shows a clear preference for the functionally ordered manual over 
the alphabetically ordered manual. 

Table 8-8 lists the completion rate for the performance tests for 
the different formats. 


Format 


Completion Rate 


Short Form Mnemonic one (SF1) 81% 
Short Form Mnemonic two (SF2) 70% 
Long Form Mnemonic 88% 
Prompted 81% 
Menu 85% 


Format Completion Rates 
Table 8-8 


Noncompletlon of the performance tests can be operator related or due to 
external causes. The equipment may have failed or have been required for 
higher priority activities (spacecraft track). Or the operator may have be- 
come fatigued or unmotivated. The completion rates for all the formats 
except for SF2 are quite consistent. He can assume that the lower completion 
rate of the SF2 format Indicates either increased operator fatigue or loss 
of motivation. This Interpretation Is consistent with the previous analysis. 


low Experience Performance 

The performance time for the first attempt at each system Is listed 
in Appendix I. It shows the Impact of the different fonnats on performance 
time for the first attempt to use each of the different systems. These 
patterns are sunmarlzed In Table 8-9 as performance rankings for each system. 


System Format 


SF1 


SF2 LF P M 


Nava Igat ion 
Propulsion 
Ship Control 
Radar 
Cannon 
Machine Gun 
Depth Charge 
Torpedo 

Totals 


4 

4 

2 

4 

4 

4 

4 

3 

nr 


4 

5 

3 
5 
5 
5 
5 

4 

3 r 


3 

3 

1 

3 

3 

1 

3 

2 

TT 


2 

1 

1 

2 

2 

3 

1 

1 

TT 


1 

2 

1 

1 

1 

2 

2 

2 

TT 


First attempt performance Ranking 
Table 8-9 
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In all systems, the two short form mnemonic formats take longer than the other 
three formats. In all but one the functionally oriented manual produced better 
performance than the alphabetically oriented manual. The rankings of the long 
form mnemonic, prompt, and menu formats are not as distinctive. The low 
complexity system (ship control) Indicates essentially no format differen- 
tial effect. The high complexity systems (Navigation, Radar and Cannon) 
Indicate a consistent format differential effect with the menu format provid- 
ing the best performance followed by the prompt format and then the long 
form mnemonic format. The medium complexity systems show mixed results. 
Summing the rankings In Table 8-9 for each format supports the observation 
that the first attempt performance difference between prompt and menu 1$ 
very slight, that the long form mnemonic format requires somewhat longer 
time, and the short form mnemonic format requires slqnlflcantly longer times. 
Summing the raw performance times from Appendix I supports these observations. 
(Table 8-10). 


SF1 

SF2 

LF 

P 

M 

785 

925 

542 

457 

447 


Performance times of first attempt 
Sumncd over all system 

Table 8-10 

It is Interesting to look at the format differentials of the 
performance times for the second attempts Table 8-11. 


SF1 

SF2 

LF 

P 

M 

624 

620 

449 

400 

401 


Performance times of second attempts 
Sunned over systems 

Table 8-11 


The performance time plots suggest that the Impact of the differences between 
formats are small by the second attempt to use a command except In the case of 
the short form mnemonic. Table 8-11 supports the difference between the short 
form mnemonic formats and the other formats. It supports the observation of 
mlnlmun difference between the prompt and the menu formats but It appears 
that overall, the long form mnemonic format requires about 10% longer than 
the prompt and menu. 
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Semantic Differential Questionnaire 

The semantic differential questionnaire at the end of the perfor- 
mance test probed the experimental operator's attitudes towards the format 
that he used for the performance tests. A seven point scale was used. 1 or 7 
are extreme response and 4 Is essentially neutral response. The responses 
for each format and each question are listed In Appendix H. 

Some specific results are: 

1. The operators liked the menu format the best, and they liked the 
short form mnemonic two (SF2) the least (Q1). All the other formats 
were liked about the same. 

2. They felt that the SF2 format was slower than the other formats (Q2). 

3. They felt that the prompt and menu formats were the most comfortable 
and the SF2 format the least confortable (Q4). 

4. They felt that the prompted format was the simplest and the SF2 
format was the most complex (Q6). 

5. They felt that the prompt and menu formats were more "friendly" 
than the mnemonic formats (Q7). 

6. They felt that the SF2 commands were harder to use (Q8) than the 
other formats, even though the SF1 commands were Identical to SF2 
ones. 

7. The operators felt that the SF2 format was harder to learn than the 
other formats (Q9), which Is statistically significant the 5% level. 

8. The prompt and menu formats were felt to be the easiest to learn. 

9. As might be expected, they Indicated the most frustration with the 
SF2 format (Q10). 

10. They Indicated that the SF2 command format was the least useful (Qll). 

11. Interestingly, the operators Indicated that they used the manual for 
looking up commands most often for the SF1 format (Q14). 
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DISCUSSION 


The first Interesting Item suggested by the experimental performance 
data Is that complexity plays a very Important role In the man computer Inter- 
face. The performance difference between tasks of different complexities Is 
greater than the performance difference between formats. And the differential 
format effects were directly related to the level of complexity. At the lower 
levels of complexity all formats performed essentially equally. At the higher 
levels of complexity the differential format effects became observable. 

The commands which Implement more complex tasks do require more time. 
This relationship Is hardly unexpected. Mhat Is Interesting Is the performance 
levels associated with the various levels of complexity. Hypothesis four Is 
supported. It appears that the average performance times once experience has 
been acquired are essentially equivalent for the long form mnemonic, prompt, 
and menu formats, and are: 

Low complexity • 20 sec 

Medium complexity - 30 sec 

High complexity - 40 sec 

The experimental data does not support hypothesis one, that operator 
performance Is greater when the computer controls the dialogue for a series of 
commands and when the operator controls the dialogue for Individual conmands. 
In retrospect, It becomes clear that the task statements did not adequately 
expose this serles/lndlvldual command condition. This hypothesis predicts 
better performance for the short form mnemonic format for Individual (or short) 
commands and the prompt or menu formats for a series (or long) conmands. The 
short form mnemonic does not show any advantage for the short commands, but 
the prompt and menu formats do show an advantage for the long conmands. 
However, this may be more concerned with the Issue of complexity rather than 
Individual/series commands. We cannot make a statement about hypothesis one 
from the existing analysis. This Issue may be more related to the error 
performance than the time performance and as such may show up In later analysis. 

Hypothesis two states that for inexperienced operators system per- 
formance Is better when the computer controls the dialogue and for experienced 
operators when the operator controls the dialogue. The data supports hypothesis 
two for inexperienced operators. However, It seems to be strongly related to 
task complexity. The low complexity tasks do not show a differential effect, 
the high complexity tasks do show a small differential effect. As the attitude 
survey Indicates, there wa; a preference for computer controlled dialogue 
(prompt and menu formats). Starr Roxanne Hlltz* Indicates that for a computer 
conferencing system which she examined, user preference was for a menu format 
until some time between 25 and 50 hours of operation. Then their preference 
switched to a command format. Apparently the naval senarlo experiment was not 
sufficiently long to expose a perference for mnemonic conmands. The rather 
small differential effects may well Indicate that the Issue Is not one of 
performance but of attitude* 

"Comments during panel discussion at the ASIS 80 meeting, Anaheim, 7 Oct. 1980. 


The experiment supported hypothesis three about the same level as 
hypothesis two. Hypothesis three states that the performance of Inexper- 
ienced operators Is greater when they have alternative actions displayed. 
There Is some support for this conclusion from the very first attempts to 
carry out the complex tasks. The effect was small and the operators appeared 
to learn rapidly. There were no observable differences for low complexity 
tasks. The other aspect of hypothesis three Is that experienced operator 
performance Is greater when the alternatives are not displayed. This relates 
to the added time required to display the alternatives. This hypothesis was 
not supported by the data. Me would expect the performance of the mnemonic 
format to be better after the experimental operators has become experienced. 
The performance time curves leveled off at essentially the same performance 
time for the long form mnemonic, prompt, and menu formats. Possibly more 
detailed analysis might expose some difference but this would not be a large 
difference. 

Hypothesis five states that performance time Is greater when the command 
argument order Is compatible with the task parameter order. The experimental 
data provided some support for this hypothesis for complex task. The tasks 
which were less complex only had two parameters and the effect was minimal. 
Again, this effect may be related more to error performance then to time 
performance, and a difference may show up when error analysis Is done. 

The experimental data provides strong support for hypothesis six. 
Operator's manuals or docunentatlon which are organized so the command lists 
are functionally organized rather than alphabetically organized leads to 
faster and more satisfying system performance. The performance times with 
functionally organized manuals were better, operator attitudes about the 
command format were better, and the completion rate was greater. 
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10.0 CONCLUSIONS 

The following comments summarize the conclusions from this experi- 
ment: 

1. There Is no one best command format. 

2. There Is one worst format* It Is the short form mnemonic. All other 
formats (long form mnemonic* prompt* and menu) start with some small 
differential effects and settle to essentially the same performance 
levels. 

3. Complexity Is a major Issue, It produces most of the observed variance 
In the experiment. The other effects appear to be related to the level 
of complexity of the tasks. 

4. Think time appears to predominate In performance times and In the variance 
of performance times. 

5. Documentaton Is Important to acceptance and performance using mnemonic 
format. The prompt and menu formats are less susceptible to degradation 
due to poor documentation. 

This experiment adequately explored short term effects but not long term 
effects. Techniques other than experiments must be used to explore long 
tern:, saturation, or overlearned effects. 
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11.0 


RECOMMENDATIONS 


There are three areas about which recommendation can be made based 

on this experiment. 

First of all. the following recommendations can be made for design 

of man-computer Interface (MCI) systems: 

1. The MCI should be designed In relation to systems usage* MCI's which are 
going to be used by Inexperienced operators, or used Infrequently by even 
experienced operators should be designed for cognitive simplicity (Appendix 
A). MCI's which are used frequently. (1.e.» everyday) by experienced 
operators should be designed for process slmpllcty. 

2. The complexity of a MCI task should be kept within cognitive limitations. 
If a basic task requires a great number of decisions then It should be 
partitioned Into a hierarchic format with a small number of decisions at 
each stage. Specifically the short form mnemonic command structure should 
not be used except for relatively simple systems. 

3. The structure and organization of a MCI should be related to the functional 

process being controlled. The operator should be able to relate his Input 

to the process that he Is trying to control. 

4. In the operator's manual, the list of commands should be organized funct- 
ionally. That Is commands should be presented In functional groups that 
simplify finding the desired one. 

The second set of recommendations Involves additional activity on 

this experimental data set: 

1. The data samples taken after the Initial closing date should oe gathered 

from the stations and Included In the data set. This will Increase the 

sample size. 

2. The data quality should be Improved by finding and removing extraneous data. 
This 1$ data which Is not representative of the operator's response, for 
example, data from tests that were aborted should be removed. 

* 3. Variables which were not scored for lack of time should be scored and ana- 
lyzed. This relates primarily to the short term memory variable and the 
error profiles on other variables. 

4. More sophisticated curve fitting should be attempted on the performance 
data. 

5. The data should be analyzed by separating out different groups (for example, 
operators/ non-operators) In order to examine population homog<~n1ty. 

6. Refine the operational definitions for task complexity. 
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Finally, the follow areas should be considered for future research: 

1. Investigations Into the long term effects of the different formats, most 
likely requiring field studys of existing systems. 

2. Investigation of command structures with the goal of developing criteria 
for optimizing the decision tree structure for MCI dialogue design. 
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APPENDIX A 


Simplicity in Command and Control Systems 
A Human Factors Consideration 


SIMPLICITY in CO**ND AMO CONTIOL SYSTEMS: 
A HUMAN FACTORS CONSIDERATION 


Roy L. Chafln 
Jot Propul lion laboratory 
California Institute of Technology 
Pasadena, California 


AISTAACT 

Simplicity In the Man Computer Inttrfaca (MCI) It a doslrablo feature. Hopefully, It makes 
the system containing the MCI *oatlor to use*. This paper uses results from a MCI study at 
the Jet Propulsion Laboratory (jpl) to identify an area oh ere the system MCIs can be simpl 1- 
fiod. It Identifies the clrcuestances where these simplifications are appropriate. The 
concepts of Cognitive simplicity and Process s*«nllc1ty are presented as MCI design alterna- 
tives. The concepts of Understandablllty, Op 'a*1on, learnebi llty, Level of learning, 
and Useablllty art presented as tools for the system designer. The use of these concepts to 
provioe a systematic MCI design is discussed. 

INTNOOUCTION 

The first thought many system designers have, when considering how to make the system easy 
to use. Is to keep it simple. Unfortunately, whet is simple to one, may not be simple to 
another. Very often, simplicity to the system designer means expressing the system in terns 
not at all simple to the user. It Is not simple to the user because he does not understand 
tha system to the same depth as the designer. In order then, to design a •simple* MCI, the 
designer needs to know the user's characteristics. Very few systems designers are prepartc 
by training, experience, or even by basic nature to ovaluete the systems user population In 
human tones. The system designers often cannot rely on Human Factors Specialists because of 
their short supply. Typically, the system designer mill have to carry the responsibll ity 
for human factors. Hopefully, this paper will be useful to the system designer in this 
capacity. This Is a conceptual paper exploring MCI simplicity to the level belo* the over- 
simplistic "keep It simple* idea. 

It was recoonixed at JNl, a National Aeronautics and Space Adminlstrition facility, that a 
need existed to improve the MCI In the command and telemetry systmes at the Deep Space 
Network (DSN) , a spacecraft tracking station network. A project was Initiated to gam a 
better understanding of the MCI dynamics. The project consisted of a series of focus groups, 
a survey, and an axperlment (1). Tht focus groups and the survey explored the operator’s 
perception of the system. Tht experiment provided comparative measurements between different 
MCI characteristics In simulated system conf Iguratlons. The concepts In this paper were 
distilled f row the focus group results. It was observed that tht effectiveness of the operator 
dapendt upon tne operator understanding ho* to operate the system,. The effectiveness also 
depends upon the operator being able to operate the system. These then are two of many 
dimensions which affect the system ease of use. The first Is labeled Cognitive simplicity. 
It is characteristic of a system trfiich is easy to use because the system Is easy to understand. 
The designer can Improve Cognitive simplicity by providing system features which aid the 
operator in undentandi ng the systmn. The second concept is labeled Process simplicity. It 
it characterized by minium physical or mental effort being required to operate the system. 
The concept that humans prefer operations with the least effort is attributed to Iipf!2). 
It has faca validity and It was also supported by the DS* MCI study. Tht system design*** 
can control the Cognitive and Process simplicities and thereby hopefully he can improve the 
effectiveness of the MCI design. These two concepts are by no means the only ones affecting 
the MCI design, but we art limited by boundaries of this peper to these two concepts. 

The concepts of understandabi llty , Operation, leamabillty. Level of learning, anc Useablllty 
art presented 1r« or,tr to provide a conctptual framework for the use of the concepts cf 
Cognitive and Frocass simplicities by system designers. They art used by the system designs** 
to analyze the system environments and to develop the rationale to select tithe** Cognitive 
or Process simplicity for a aptcific MCI design. 

Proceedings of the 1980 International Telemetering Conference 
14-16 October 1980, San Diego, California 
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cognitive simplicity 




A process which h*s Cognitlvt ilapllelty Is out which Is sas; to undtrstand. The process 
■ay h*v* Cognitive simplicity btetust It Is basically sIm'*- It My hare Cognitive simplic- 
ity because It Is compatible with the operators prior oaperlence or knowledge. Cognitive 
simplicity My be Sue to cognitive aides being included in the design of the Interface for* 
Mt. That Is, aids srfiich facilitate the operator's understanding of the NCI. They are 
typically structured aids such as menus or prompts which lead the operator through the NCI 
dialogue. They can also be structural elements In the NCI coMand formats which allow the 
operator to more easily separate the elements of the cavand format. Delimiters can be usee 
In a caMsand format to set off parameters and identify types of parameters. 

for example: 

IPC/36,2(10),16 (1) 

the slash (V) separates the mmonlc conand name (IVC) from the argument parameters 
(36,2(10), 18). The commas separate the parameters and tha parenthesis Identify an optional 
paraMter. Conversely, conand formats which are separated by only spaces are more cogni- 
tively comptai because they do not provide the cognitive aids which help the operator under- 
stand the comMnd structure. 

Cognitive simplicity can be enhanced In a system by providing complete and fully explanatory 
error and status messages, on-screen Instructions, or on-call help Instructions. Complete 
and fully explanatory means that the messages contain all the Information necessary to under- 
stand the comMnd process. It also means that t: e context Is well established. English 
language characteristics can be used to enhance the understanding. Subject, verb, object 
forms can be used together with redundancy to Increase understanding. This Is the natural 
language concept suggested by Mny. 

PROCESS SINPLICITY 

Process simplicity relates to the relative ease Mich tasks can be accomplished. This My 
deal priMrily with anthropological characteristics of the computer system operators. For 
example, with typing tasks. Issues such as finger reach, keystroke pressure, key cap size, 
key spacing, etc. (3) are Important. The obstacles to Process slMlIcIty are then physiolo- 
gical limitations, such as finger reach, arm movements, etc. 

Process simplicity My also deal with the mental effort required to operate a system. The 
actions My be basically cognitive activities such as selecting an It am out of a population 
of Items. The obstacles to Process simplicity then are psychological limitations such as 
short term memory, motivations, etc. Note that this concept Is different than Cognitive 
simplicity in which we are concamed with the mental effort required to understand the pro- 
cess. The difference between the concepts Is the difference between the effort required to 
understand the process versus the effort required to accomplish the process. 

UNDERSTAND ABILITY 

Undersundablllty (Figure 1-A) Is the ease of which the system can be understood by the 
population of operators. Understanding a system is the process of an Individual developing 
a model of the systam(4,5) within the his own mind. On one end of this dimension, the 
parts of the sjrstem and their Interrelationships fit together well In the Individuals mind. 
On the other end of the dlMnslon, the Individual cannot identify parts of the system 
(•it Is a black box*) or cannot determine the relationship between parts (‘beats me how It 
worts*). System understandabillty then Is an aggregate Mature over the operator population 
of the state of Individuals minds or their attitudes about the systmx's ease of understanding. 
It can be Matured with a self-reporting questionnaire. This Mature can provide a relative 
Mature for comparing different systems, but does not provide an absolute Mature. 

OPERATION 

• 

The concept of Operation (Figure 1-0) can be described by considering the two en of the 
dimension. On one and, the operator can operate a system based on his good understanding o 4 
that syst am. That Is, he has a good internal model of the system. On the other end, he may 
not uhde»-stand the system, but operates It by rote, or by previously established procedures. 
Either method is rtisonable and can lead to effective system operation depending upon the 
emitting environment. Again, the system can be characterized by the aggregate of measures 
taaen ov?r the operator population. 


A- 2 



Understanoabl 1 ity 





(A) 


tun: to Unoe-stand Easy to Unde-T^anc 


Operation 

. (I) Qy Rote |y functional Underst anding 

Uaas Procedures boot not Use 
Strictly Procedures 


Leamablllty 


(0 Lfi_ 


to loam 


H<oh 

Easy to Learn 


Level of Learning 

llnder Must Use Normally Uses ieldom Uses Has to Think Over 

Learned Documentation Documentation Doctmmntatlon About Operating Laamed 


Useablllty 

(E) lo»» mg* 

Hard to Use Easy to Use 


Figure 1. Concept D loans Ions 


LEAAHABILITT 

Leamablllty Is one of those concepts which It easy to Inadequately define. The difficulty 
It: learning what? If* this paper, system Leamablllty Is llailted to learning hoe to operate 
the system. Note that leamablllty and Understandablllty are separate concepts. An operator 
can learn to operate a system without understanding the system. He can operate from procedures 
(by rote). The dimension (Figure l-C) varies from hard to learn to easy to laam. Easy to 
loam can apply to the idea that It Is easy to learn the operating procedures or that It Is 
easy to loam to operate the syston by functional understanding. Leamablllty can be measured 
by the time required for an operator to attain some proficiency level. The systam Leamablllty 
Is an aggregate of the individual measures over the operator population. 

LEVEL OF LEARNING 

Level of learning (Figure 1«D) progresses fra* "underleamed" In which the operator essentially 
does not know how to operate the system to "overleamed* In *i1ch the operator can operate 
the system without having to think through each step (l.a. automatically). The conceot can 
also be considered In terms of the mental effort required to operate the system. When an 
individual is "underleamed*, extreme mental effort (6) Is required. Increased Level of. 
learning brings the Individual to where he can operata the systam with the help of documents* 
tlon or assistance from other people. As his Level of learning increases, he required less 
help from the documentation or other sources. Until he reaches an overleamed condition in 
which he needs no external assistance and furthermore he does not even have to think about 
the process In order to operate the system. An example Is touch typing, a trained typist 
does not have to think about which finger Is going to type a particular character, it is 
automatic. 

Level of learning is a characteristic of the operator population and thus Is an environmental 
factor to system design. However, the Level of ’earning measure of the operator population 
is Influenced by the Leamablllty concept which Is a systam factor, when the Leamablllty 
of a system Is high, we can expect that the Level of learning will be higher for that systam 
with any given operator population than for a systam with low Leamablllty. 
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Uaeablllty (Flour* 1»E) 1* eoncernee with the HU of operating tho i/itw. It varies fnpi 
kira>tHiu to easy-to-use. T»*o oeasurt of uaeablllty for system It an aggregate oeasure of 
tho operator population's perception of how easy It It to operate tho system. It Is obtained 
through a self -reporting questionnaire. uaeablllty la related to both cognitive effort 
required (l.e. mental effort) and to physical effort required. Mien the system Is being 
operated at a relatively low Level of learning, Uaeabillty Is primarily a cognitive issue. 
That is, the operator eust thine through each step of the process and he has to txart extreme 
effort to understand uhat he is attempting to accaacllsh. Mien the systee is being operated 
At a relatival/ high Level of learning, it is principally a mini aw effort Issue. The 
operator does not have to expend effort to learn the system. He wants to expend the least 
Physical effort In accomplishing the tesl^, l.e. taring In data, etc. And also wants to 
expend the least aental effort In evaluating conditions end making decisions. 

COGNITIVE SIMPLICITY VERSUS PROCESS SIMLICITY 

Cognitive simplicity or Process simplicity within the maivcaputer Interface design are 
alternates available to the system designer. The Interface can be designed to aid the under, 
standing of the process or it can be designed to aid accomplishing the process. The choice 
of using » menu Interface versus a aiemonlc Interface Is an example of these choices. Several 
authors have suggested that asm Interface designs are useful when the user is learning the 
system, but he tends to became Impatient when he knows the system and what he has to do (4,7). 
Menu Interfaces usually are exe^les of Cognitive simplicity. They tend to be easy to under, 
stand and easy to learn. They tend to not have Process simplicity, because It often requires 
more effort to traverse through a aeries of merus than to ontor a single mnemonic eemnand to 
occompllsh a task. Also, waiting for the wenu to bo displayed tends to destroy the operator's 
mental pacing. 

Process simplicity In • MCI design Is related to tho effort required to accwpllth the task. 
For exawmla. Process simplicity Is obtained by ‘minimizing the iwmfcer of key strokes or the 
effort required to accomplish keystrokes. Mnemonics with single characters provide 
Procass simplicity because of tha arinlmw keystrokes. But a longer mnemonic (when properly 
designed) may have Cognitive simplicity, that Is, It It easier to understand. For example, 
*0* for display request can be keyed with only one keystroke, but *D!SPLAY* for display 
request Is easier to understand. Which Is better? It depends on the complexity of the task 
and the Level of learning associated with the ooerator population. A simple system task 
should allow a man-computer Interface design Milch Is both cognitive anJ process simple. 
Martin (8) describes an airline reservation system which usts tingle character mnemonics and 
each mnemonic 1* clearly related to Its subject (1o, *E* for End). However, for a systan- 
MCI which Is more complex, that Is, It has a greater repertoire of coranands, the single 
character loses Its Cognitive sl^lldty because of £be large discrimination space In which 
the operator has to wort. He has wore things to scan In deciding which conwnd to use. And 
also, chances of awfciqulty Increase. For example, does *0* mean Display or Delete? In the 
DSN tracking station system man-computer Interface study, the operators fait that three 
character mnemonics were about right. This was Inflwancad by the fact that the systmn that 
they were normally use has throe character aiamonics. What was Interesting was that they 
did feel comfortable with the mnemonics. Three character mnemonics were appropriate for the 
command complexity of that specific system. 

The systam, which the operators In tne DSN study aoraally use, Is a mnemonic design. A 
■wmonlc MCI design uses a camund Identifier, the mnemonic, and a list of arguments to 
apply to the commnded action. Tha operator has the eptlon of using c«mas, flashes, colons, 
otc., or spaces for delimiters. 

For example: 


RYT/26, 15:46:24 (2) 

XTZ 26 154624 (3) 

The first example has Cognitive tlM>11c1ty, the second has Frocess ti*>11dty. The delimiters 
in the first example provide Cognitive simplicity because they dearly delineate the mnemonic 
from Its arguments (/), the arguments themselves (,), and tha eubparts of the tine word (:) 
for hours, minutes, and seconds. The spaces used as delimiters In the aecond example provioe 
Frocess simplicity in that they are considerably easier to use than the other delimiters. 
The spaca kay is larger than the other keys. Fitts (•) ind'cetes better accuracy will 
be attained with a large*- key, because the ooerator Is loss llaely to miss the key. For 
operators who touch type, the space bar is hit with the th»»o which has no other responsibil- 
ities. And tha spaca bar dots not require e ahlft key. keystrokes Milch require shifting 


»rt particularly bothersome. They greatly reduce the Process simplicity. The Level of 
learning for the DSN system Indicated better effectiveness for the Process simplicity 
alternative (space delimiter option). A different systan with a lover level of learning 
vould suggest that the dellalter option with greater Cognitive simplicity would he aore 
effective. 

Error and status aessages are another area In «Mch the systan desiper can utti se his 
design prerogatives. Ne can design the systaa error and status aessages to he either short 
and concise or long and esplanatory. They can he in the operators terminology or the designer 
terminology. The aessages can explain the systM fault only or they can additionally suggest 
recovery actions. The previous concepts can he used to help the designer choose the error 
and status aessages characteristics. 

Syt'ans operating In a lev Level of learning envlrenaant call for Cognltlw simplicity. The 
system aessages should he easy to understand. They should he long enough to be self- 
explanatory. Systans operating in a high Level of learning environment can he designed with 
Process simplicity. The frequency In which the aessage appears generally determines the 
Level of learning for that aessage. When a aessage appears very often, the operator recognizes 
the aessage lamdlately. Often, he recognizes It by Its fora rather then Its content. That 
Is. he recognizes the pattern, say the nuafcer of words or the size of words. This condition 
calls for a aessage with Process slapllclty. It should he short so that It does not tie up 
the Input/Output terminal and it does net aake the operator wait for Its completion. Messages 
which are infrequent, call for Cognitive si^llclty. They should he eoa^lete In their content, 
because the operator requires the content. In order to understand the net sage. * These aessages 
tend to be longer. A special case Is a aessage which warns of a high risk systan condition. 
When the risk associated with artsunderstanding a systaa aessage Is high, that aessage should 
be copitlvely simple. It should be co^lete and self-explanatory even though It aay be 
long and aay appear often. 

Copltlve simplicity and Process simplicity are not mutually exclusive. A systaa aessage 
aay have both Cognitive and Process slapllclty, l.e. It can be high In both dimensions. It 
can be short and coapletely understandable. Of course that Is preferable, hut not always 
obtainable. The opposite can also be true. The aessage aay be low In both dimensions. It 
aay be long and difficult to understand. 

Whether the aessage Is cognitively slaple or complex Is determined largely by whether It Is 
presented in the operators terminology or the designer's terminology. That Is, sdiether It 
fits the ooerator's Internal aodal or tt«e designer's Internal aodel. Consider for example 
the following aessages: 

•The telemetry data rate Is exceeding the system capacity.* 

“Step 26t Is aborted.* 

*TLM buffer overflow.* 

The first aessage Is appropriate to an operator's Internal aBdel when operating by functional 
understanding. It refers to the functional process of the systaa. The second aessage is 
appropriate to an operator's aodel when operating by procedures. It refers to a procedure 
step rather than the system Itself. The third «ssage Is Inappropriate because It Is presentee 
in terms of the systems Internal design. It represents the designer's internal aodel not 
the operator's. 

Error, warning, or fault aessages can enhance cognitive sl^llclty by suggesting recover 

action. The first aessage might also say “Reduce spacecraft teloaetry data rata.* The 

second aessage aignt go on to tell the operator to *So to Anowly Procedure NM.* Again, 
the action suggested Is In tents of the operating acthod expected. When operating by func- 
tional understanding (Figure 1-1), the recovery action should be given In terms of the system 
functions (l.e. reduce telemetry data rate). When operating by procedures (Figure 1-8 ) . the 
recovery action should be given in terms of the procedures being used. 

DISCUSSION 

Concepts such as have been presented In this paper are only good when they can be usee. 
This discussion will address the issue of how these concepts can be used In syste* design.. 
Initially, the system das ignjr oust analyze the system goals. In addition, to the functions', 
cost, and schedule requirements, hunan factor goals should be analyzed. Usually, this is 

fairly simple, we want to aaxlalze useabillty and hopefully thereby gain the aost from the 

operator staff. However, other goals aay bo laportant, possibly political goals for example, 
•his analysis will affect later design efforts. 
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The environment factor* which Influence th« i/ttn design CO" O* analyzed In toms of the 
previous concepts. The Oporatlon concept 1l Influenced by management desires. The military 
very often operates by rote or procedure (*000*1 try to understand It, Just do idiat you ere 
told.*) The Oporatlon concept Is Influenced by such factors as personal turnover rates. 
For operations with leu turnover, operation by functional understanding Is appropriate; 
aipeeially uhen the operators are uell trained, experienced, and the operations task is 
somewhat unstructured. The JPL DSN has a relatively leu operator turnover and the operators 
art veil trained and are experienced. However, the high risk of failure in spacecraft 
operations sake a catenation of operating by procedures and by factional understanding 
appropriate. 

The Level of learning Is determined by the Interaction of the eperator population skill 
levels and the Leamabllity of the system. The type of user Influences the expected Level 
of learning. Novice user vlll probably operate the system In an underleamed state. Casual 
users would operate the systae with a higher Level of learning. They would have a basic 
understanding, but would require relearning details every tlwe that they operate the system. 
Dedicated and experienced eperators would probably operate the system at an overl earned 
level. 

Cognitive simplicity and Process simplicity are used to tailor the operation of the system 
to natch the environment at analysed with the proceeding concepts. For exanple, the tracking 
stations of the JPL DSN operate at close to an overleamed condition. Seme procedures are 
available for operations, but the operators normally work by functional understanding. The 
tracking station operational systems that are used everyday to treck spacecraft, mostly have 
Process sl^llrlty. The Initial surveys conducted by the Htmnn Factors Project Indicated 
that the NCI design was appropriate for the existing Level of learning and the type of 
Operations except for one area. The initialization of the systems require a sequence of 
Inputs to set up the system configuration. Same operators felt uncomfortable because the 
sequence required a higher level of understanding than existed and the process was prone to 
operator errors. The recommendation was to change the Initialization frw a mnemonic design 
to a prompted design In order to gain Cognitive simplicity. Another area that requires 
jester Cognitive simplicity Is the systems which are used Infrequently, such as the utility 
programs, dtap programs, test programs, etc. The users must relearn them each time they are 
used. It Is not cost effective to develop procedures for their use. they art used infre- 
quently and very often are used on rather unstructured tasks (l.e., troubleshooting). An 
NCI design with greater Cognitive simplicity Is more appropriate, such as a menu or prapted 
desl gn. 

CONCLUSIONS 

This paper has presented a series of concepts which hopefully provide a theoretic foundation 
for one small area of man-c«p u ter Interface design. The concepts provide an analytic tool 
for specific NCI design projects. Admittedly, this design approach may present difficulty 
to the NCI designer. Concepts are much harder to use than guidelines. Theoretical analysis 
pieces a greater burden on the designer to understand and properly use the concepts. Assuming 
that the concepts and their relationship are realistic and that the added analytic cwplexlty 
Is mastered, the benefit Is a more systematic NCI design which will hopefully lead to a 
better NCI des1p>. 

The concepts of Cognitive and Process simplicity provide the NCI designers with specific 
de*)pt alternatives. The concepts of Operation and Level of learning provide the framewor* 
for selecting either Cognitive or Process simplicity for the NCI design. The concepts of 
Understandablllty and Loarnablllty provide tools for the evaluation and comparison of different 
NCI designs. And the useablllty concept provides an analysis and evaluation tool for the 
NCI design in terms of the system objectives. 

KECOrtCKDATIONS 

The concepts of Understandablllty, Leamabllity, Operation Level of learning, and Useablllty 
are presented In this paper to support system analysis In developing the rationale for select- 
ing either Cognitive or Process slmapl id ty . The depth of this pape- predicated limited 
discussion of these concepts. Funner conceptual refinement Is recommended. Ano In orde- 
to provide working tools for the systam designer. It Is recommended that guidelines be devel- 
oped for specific application areas and measuring instruments be developed for each concept. 
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APPENDIX B 

Experiment completion statistics 
Format Frequencies 


FORMAT 


Short form mnemonic one 
Short form mnemonic two 
Long form mnemonic 
Prompted 
Menu 

Totals 


MACHINE 

TEST 

TEST 

EXPECTED 

STARTS 

STARTS 

COMPLETIONS 

FREQUENCIES 

17( 6.8%) 

16(10.0%) 

13(12.2%) 

12.5% 

20(10.3%) 

17(10.5%) 

7( 6.6%) 

12.5% 

56(28.8% 

43 26.7% 

30(28.3% 

25.0% 

60(31.0%) 

49(30.4% 

34(32.0%) 

25.0% 

41(21.1%) 

36(22.3%) 

22(20.7%) 

25.0% 

T9TTTMT 

unroKT 

106 (100%) 

106.64 


Performance test completion by format 


FORMAT 

PERF TEST 

SIG 

PERF TEST 


STARTED 

PERF TEST 

COMPLETED 

Short form mnemonic one 

16(10°%) 

14(87%) 

13(81%) 

Short form mnemonic two 

10(100%) 

8(80%) 

7(70%) 

Long form menmonic 
Prompted 

34(100%) 

42(100%) 

31(91%) 

36(86%) 

30(88%) 

34(81%) 

Menu 

26(100%) 

24(92%) 

22(85%) 

Totals 

135 ( 1664 ) 

113 ( 874 ) 

108 ( 824 ) 
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APPENDIX C 

Cannand Formats 


Short Form Mnemonic On# Command format 


Software Operators Manual 

The following commands are used in the command directive test. 

navigation System 

Longitude: lon/AAA BB CC 0 

AAA 1$ the longitude degrees (0 - 3S9). 

BB Is the longitude minutes [0 - 59). 

CC Is the longitude seconds (0 - 59). 

0 Is east or west longitude (E/W). 

example: lon/89 50 12 E 

Latitude: lat/AAA BB CC D 

AAA Is the latitude degrees (0 - 359). 

BB Is the latitude minutes (0 - 59). 

CC Is the latitude seconds (0 - 59). 

D Is north or south latitude (N/S). 

example: 1 at/218 45 1 N 

Day of year for the arrival: doa/AAA 

AAA Is the day of year for the ship's arrival (1 * 366). 

example: doa/256 

Time of day for the arrival: toa/AAAA 

AAAA Is the time of day for the ship's arrival In GMT (0 - 2400). 
example: toa/1800 
Status: nav/status 

Navigation system status request. 

Ship Control System 
Heading: hed/AAA 

AAA Is the commanded ship's heading In degrees (0 - 360). 
example: hed/270 
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Speed: spd/AA 

AA Is the commanded ship's speed In knots, 
example: spd/18 

Status: shp/status 

Propulsion Control System 

Select type of fuel: ftp/A 

A Is either bunker fuel 1, 2, or 3 
example: ftp/1 

Note: When the fuel type Is selected, the fuel flow rate and the 
boiler pressure must also be changed. 

Fuel Flow Rate: frt/AAA 

AAA Is the fuel flow rate In KG per hr. (100 • 600 KG per hr.), 
example: frt/200 
Boiler pressure: bpr/AAA 

AAA Is the commanded boiler pressure In PSI (50 - 250 PS1). 
example: bpr/100 
Status: prp/status 

Radar Control System 

Mode control : mde/AAA 

AAA Is either scan for the scan mode, or track for the track mode, 
example: mde/scan 

Note: The mode command must be entered first for scan or track 
mode changes. 
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For the scan mode, the following commands must be entered. 

Moving Target Indicator: mtl/AA 

AA selects the moving target Indicator either on or off (on/off), 
example: mtl/on 

Note: The MTI command must be set In the scan mode but must not 
be set In the track mode. 

Beam width: bwd/AAAAAA 

AAAAAAA selects the beam wide to narrow, medium, or wide, 
example: bwd/medlum 

Note: The beam width must be set In the scan mode but must not 
be set in the track mode. 

For the track mode, the following command must be issued. 

Target direction: rdr/AAA 

AAA is the direction to the target in degrees (0 - 360). 
example: rdr/289 

Note: The direction command must be Issued in the track mode 
but must not be issued in the scan mode. 

Range: rng/AAA 

AAA is the range scale for the scan mode and the target acquisition 
scale for the track mode. The range of values is 5,10,15,25,50,100 KM 

example: rng/15 

Note: The range command must be set in both the scan and the track modes. 
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Pulse rate: prt/AAA 


AAA Is the pulse rate In PPS (50,100,150,250,500,1000 PPS). 
example: prt/100 

Note: The pulse rate must be set for scan or track mode. It can 
be changed without changing the modes. In which case It Is 
entered without the mode command. The power level must be 
set whenever the pulse rate 1$ changed. 


Power level: plv/AA 

AA sets the transmitter power level In KW's (1,5,10 KW). 
example: plv/10 

Note: The power level can be changed for the last configuration. 
If the pulse rale Is changed, It must be entered before the 
power level command. 


Status: rds/status 


Fire Control System 
Torpedo system 

Torpedo Tube select: tbn/A 

A is the selected torpedo tube number (1 - 4). 
example: tbn/3 

Torpedo warhead select: twh/AA 

AA selected the warhead for the torpedo . The chose Is between 
high explosive (HE) or armor piercing (AP). 

example: twh/AP 

Target range: trg/AAAAAAA 

AAAAAAA is the range to the target In meters, 
example: trg/ 13000 


Torpedo running speed: tsp/AA 

AA Is the torpedo running speed In knots, 
example: tsp/25 

Torpedo running depth: tdp/AA 

AA Is the torpedo running depth In meters, 
example, tdp/10 

Status: tpd/status 

Cannon system 

Platform number: pno/A 

A Is the number of the gun platform containing the selected cannon (1 - 6). 
example: pno/3 

Gun size: gsz/AA 

AA selects either the 20 mm cannon (20) or the 125 mm cannon (125). 
example: gsz/125 

Target altitude: cal/AAAA (20 mm cannon only) 

AAAA Is the altitude in meters of the aircraft target for 
the 20 mm cannon In the anti-aircraft mode. 

example: cal/500 
Target direction: cdr/AAA 

AAA is the direction of the target in degrees (0 - 360). 
example: cdr/245 
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Target range: crg/AAAAAA 

AAAAAAA Is the range to the target In meters, 
example: crg/200000 

Number of rounds: nrd/AA 

AA Is the number of rounds to be fired, 
example: nrd/200 

Warhead select: cwh/AA 

AA Is either HE for high explosive. AP for armor piercing, or 
SP for shrapnel. 

example: cwh/SP 
Status: cst/status 

Machine gun system 

Machine gun number: mgn/A 

A Is the machine gun number (1 - 20, or all) 
example: mgn/15 

Machine gun size: msz/AA 

AA Is 30 for .30 caliber machine guns and 50 for .50 caliber ones, 
example: msz/50 

Target direction: mtd/AAA 

AAA Is the direction to the target In degrees (0 - 360). 
example: mtd/145 
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Target range: mtr/AAAAAA 

AAAAAA Is the range to the target In meters, 
example: mtr/12000 

Cease Fire: cfr/ 

This commands the previously selected machine guns to cease firing. 
Status: mgs/status 

Depth charge system 

Number of depth charges: dcn/A 

A 1$ the number of depth charges to be dropped, 
example: dcn/5 

Depth charge size: dsz/AAA 

AAA Is either 100, 250, or 500 KG's to select the size of the 
depth charges to be dropped. 

example: dsz/250 
Interval: int/AA 

AA is the number of seconds Interval between dropping the Individual 
depth charges. 

example: 1 nt/15 
Firing depth: dpt/AA 

AA is the firing depth in meters set into the depth charges, 
example: dpt/60 

Status: dcs/status 
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Short Form Mnemonic Two Command Format 
Software Operators Manual 

The following commands are used in the command directive test. 

bpr/AAA Boiler pressure, propulsion control system. 

AAA Is the commanded boiler pressure In PSI (50 - 250 PSI). 
example: bpr/100 

bwd/AAAAAA Beam width, scan mode, radar control system. 

AAAAAA selects the beam width to narrow, medium, or wide, 
exampl e : bwd/medi urn 

Note: The beam width must be set In the scan mode but must not 
be set In the track mode. 

cal/AAAA Target altitude, cannon system (20 mm cannon only). 

AAAA is the altitude In meters of the aircraft target for 
the 20 mm cannon In the anti-aircraft mode. 

example: cal/500 

cdr/AAA Target direction, cannon system. 

AAA is the direction of the target in degrees (0 - 360). 
example: cdr/245 


cfr/ Cease fire, machine gun system. 

This commands the previously selected machine guns to cease firing. 

erg/ AAAAAA Target range, cannon system. 

AAAAAA is the range to the target In meters* 
example: crg/20000 

cst/status Status, cannon system. 
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cwti/AA Warhead select , cannon system 

AA Is either HE for high explosive, AP for armor piercing, or 
SP for shrapnel. 

example: cwh/SP 

dcn/A Number of depth charges, depth charge system 

A Is the number of depth charges to be dropped, 
example: dcn/5 

dcs/status Status, depth charge system 

doa/AAA Day of year for the arrival, navigation system. 

AAA Is the day of year for the "hip's arrival (1 - 366). 
example: doa/256 

dpt/AA Firing depth, depth charge system. 

AA Is the firing depth in meters set Into the depth charges, 
example: dpt/6P 

dsz/AAA Depth charge size, depth charge system. 

AAA Is either IOC, 250, or 500 KG's to select the size of the 
depth charges to be dropped. 

example: dsz/250 

• frt/AAA Fuel flow rate, propulsion control system. 

AAA is the fuel flow rate In KG per hr. (100 - 600 KG per hr.), 
example: frt/200 


ftp/A Select type of fuel, propulsion control system. 

A Is either bunker fuel 1, 2, or 3 
example: ftp/1 

Note: When the fuel type Is selected, the fuel flow rate and the 
boiler pressure must also be changed. 
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gsz/AA Gun size, cannon sytem. 

AA selects either the 20 mm cannon (20) or the 125 ran cannon (125)* 
example: gsz/125 

hed/AAA Heading, ship control system. 

AAA Is the commanded ship's heading In degrees (0 - 360). 
example: hed/270 

Int/AA Interval, depth charge system. 

AA Is the number of seconds Interval between dropping the Individual 
depth charges. 

example: 1nt/15 

1 at/AAA BB CC 0 Latitude, navigation system. 

AAA Is the latitude degrees (0 - 359). 

BB Is the latitude minutes (0 - 59). 

CC Is the latitude seconds (0 - 59). 

D Is north or south latitude (N/S). 

example: lat/218 45 1 N 

lon/AAA BB CC D longitude, navigation system. 

AAA Is the longitude degrees (0 - 359). 

BB Is the longitude minutes (0 - 59). 

CC Is the longitude seconds (0 - 59). 

0 Is east or west longitude (E/W). 

example: lon/89 50 12 E 

mde/AAA Mode control, radar control system. 

AAA Is either scan for the scan mode, or track for the track mode, 
example: mde/scan 

Note: The mode command must be entered first for scan or track 
mode changes. 
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mgn/A 


> 

Machine gun number, machine gun system. 

A Is the machine gun number (1 - 20, or all), 
example: mgn/15 

mgs/status Status, machine gun system. 

msz/AA Machine gun size, machine gun system. 

AA is 30 for .30 caliber machine guns and 50 for .50 caliber ones, 
example: msz/50 

mtd/AAA Target direction, machine gun system. 

AAA Is the direction to the target In degrees (0 - 360). 
example: mtd/145 

mtl/AA Moving target Indicator, scan mode, radar system. 

AA selects the moving target Indlctor either on or off (on/off), 
example: mtl/on 

Note: The MTI command must be set In the scan mode but must not 
be set In the track mode. 

mtr/AAAAAA Target range, machine gun system. 

AAAAAA Is the range to the target In meters, 
example: mtr/ 12000 

nav/status Status, navigation system. 

nrd/AA Number of rounds, cannon system. 

AA Is the number of rounds to be fired, 
exampl e: nrd/200 
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Power level, radar control system 


plv/AA 

AA sets the transmitter power level In KW's (1, 5, or 10 KW). 
example: pi v/10 

Note: The power level can be changed for the last configuration. 

If the pulse rate Is changed. It must be entered before the 
power level command. 

pno/A Platform number, cannon system. 

A Is the number of the gun platform containing the selected cannon(l - 6). 
example: pno/3 

prp/status Status, propulsion control system. 

prt/AAA Pulse rate, radar control system. 

AAA Is the pulse rate In PPS (50,100,150,250,500,1000 PPS). 
example: prt/100 

Note: The pulse rate must be set for scan or track mode. It can 
be changed without changing the modes, In which case It Is 
entered without the mode command. The power level must be 
set whenever the pulse rate Is changed. 

rds/status Status, radar control system. 

rdr/AAA Target direction, track mode, radar control system. 

AAA Is the direction to the target In degrees (0 - 360). 
example: rdr/289 

Note: The direction command must be Issued In the track mode 
but must not be Issued In the scan mode. 

rng/AAA Range, radar control system. 

AAA Is the range scale for the scan mode and the target acquisition 
scale for the track mode. The range of values Is 5,10,15,25,50,100 KM. 

example: rng/15 

Note: The range command must be set In both the scan and the track modes. 
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shp/status Status, ship control system. 

spd/AA Speed, ship control system. 

AA Is the commanded ship's speed In knots, 
example: spd/18 

tbn/A Torpedo tube select, torpedo system. 

A Is the selected torpedo tube number (1 - 4). 
example: tbn/3 

tdp/AA Torpedo running depth, torpedo system. 

AA Is the torpedo running depth In meters, 
example: tdp/10 

toa/AAAA Time of day for the arrival, navigation system. 

AAAA Is the time of day for the ship's arrival In GMT (0 - 2400). 
example: toa/1800 

tpd/status Status, torpedo system. 

trg/AAAAAA Target range, torpedo system. 

AAAAAA Is the range to the target In meters, 
example: trg/ 13000 

tsp/AA Torpedo running speed, torpedo system. 

AA Is the torpedo running speed In knots, 
example: tsp/25 

twh/AA Torpedo warhead select, torpedo system. 

AA selects the warhead for the torpedo. The chose Is between 
high explosive (HE) or armor piercing (AP). 

example: twh/AP 
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Long Form Mamonlc Cowwand Format 


Software Operators Manual 

The following ccrnnands are used to control the ship in this exercise. 

The delimiters between the parmeters of these ccm man d s can be either spaoes or 
comas. Except where parameters are skipped and comas are required to 
identify missing parameters. 


Navigation system 


nav/AAA,BB,(X,D,EEE,FF,X,H,III,JJJJ 


where: 

AAA is the longitude degree s (0-359) . 

BB is the longitude minutes (0-59). 

CC is the longitude seconds (0-59) . 

D is the east or west longitude (E/W). 

EEE is the latitude degrees (0 - 359). 

FF is the latitude minutes (0 - 59). 

GG is the latitude seconds (0 - 59). 

H is north or south latitude (N/S). 

Ill is the arrival day of year (1 - 366). 

JJJJ is the arrival time of day (0 - 2400 )0!T. 

example: nav/186,57,32,E,97,3,16,S,226,1800 

lt> request status: nav/status 


Ship control system 
ship/AAA, BB 
Where: 

AAA is the ship's heading in degrees (0 - 360). 

BB is the ship's speed in knots. 

example: ship/180 15 

Note: The ship's heading and speed can be ccnmanded separately. 

example: ship/127 
ship/, 21 


lb request status: ship/status 
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Propulsion system 
prop/A, B8B, CCC 
•Where: 

A Is the type of fuel selected (1, 2, or 3). 

BBB Is the commanded fuel flow rate In KG per hr (100 - 600 KG per hr.)* 
CCC Is the commanded boiler pressure In PSI (50 to 250 PSI). 

example: prop/1 200 100 

Note: The fuel flow rate and boiler pressure can be changed without 
changing the fuel type. 

example: prop/ ,300, 250 


To request status: prop/status 


Radar system 

radr/scan,AAA,BB,DD,EEE,FF 
for the scan mode and 
radr/track,CCC,DD,EEE,FF 
for the track mode 
Where: 

scan selects the scan mode, 
track selects the track mode. 

AAA Is the scanning beam width (narrow, medium, or wide). 

BB Is the MTI control (on/off) for scan mode only. 

CCC Is the target direction In degrees for acquisition (0 - 360), 
for track mode only. 

DO is the range selector In KM (5 - 100 KM) for the scan mode. 

OD Is the target acquisition range In KM (5 • 100 KM) for the track mode. 

EEE Is the pulse rate In PPS (50 - 1000 PPS). 

FF Is the transmitter power level select In KW (1, 5, or 10 KW). 

examples: radr/scan,med1um,off,10,150,5 

radr/track ,256,100,500,10 

To change pulse rate and power level only for scan mode: 
radr/scan,,,250,10 

To change pulse rate and power level only for track mode: 


radr/track,,250,10 
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Note: For abbreviated commands the mode must be consistent with 
the previously selected mode. 

To change the power level only: 

radr/scan,,,,,5 

raur/track.,,,5 

To request status: radr/status 


Fire Control System 

The following commands control the firing systems, torpedo, cannon 
machine gun, and depth charge. 


Torpedo 

f1ret/A,BB,CCC,DD,EE 

Where: 

A Is the torpedo tube number (1 - 4). 

BB Is the warhead select 
HE for high explosive 
AP for armor piercing. 

CCC Is the range to the target In meter.;. 

DO Is the torpedo running speed In knots. 

EE Is the torpedo running depth In meters. 

example: f1ret/4,AP,lE000,35,15 


To request status: fl ret/status 




Cannon 

f 1 rec/A,BB .CCCC ,DDDD ,EEEE ,FFF ,GG 
Where: 

A Is the gun platform number (1 - 6). 

BB Is the size of the gun selected (20 for 20 mm, 125 for 125 mm). 
CCCC Is the target altitude In meters (20 mm gun only). 

ODDD Is the target direction In degrees (0 - 360). 

EEEE Is the target range in meters. 

FFF Is the number of rounds to be fired. 

GG Is the warhead select, 

HE for high explosive, 

AP for armor piercing, 

SP for shrapnel. 

exampl es : f 1 rec/4 ,20 ,850 ,135 ,1800 , 10 ,HE 
firec/3, 125,, 45, 18000,2, SP 


To request status: flrec/status 


Machine Gun system 

f i remg/A , BB , CCC , DDDD 
Where: 

A is the machine gun number (1 - 20, or all). 

BB is the machine gun size, 

30 for .30 caliber, or 
50 for .50 caliber. 

CCC is the target direction in degrees (0 - 360). 
D000 is the target range in meters. 

example: firemg/3 30 105 800 

To cease firing: 

firec/cease fire 

To request status: 

firec/status 
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Oepth Charge system 

f1redc/A,BBB,CC,DD 

Where: 

A Is the number of depth charges to be dropped. 

BBB Is the size of the depth charges (100, 250, or 500 KG). 
CC Is the interval In seconds between depth charge drops. 

00 Is the fire depth In meters set Into the depth charges. 

example: firedc/4 100 20 25 

Status: 

firedc/status 
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Prompt Command Format 
Software Operators Manual 

The following prompts will be Issued with the corresponding responses 
expected. Underlining Indicates specific response options. Each 
response is terminated with a carriage return. A prompt can be bypassed 
with a carriage return response. 

Prompt Response 

System 

SYSTEM? navigation 

Thip 

propulsion 
radar 

Tire control 

Navigation System 

STATUS? pes requests navigation system status 

m> no or CR selects next prompt 

LONGITUDE? Enter longitude In degrees, minutes, seconds, and past or west 

LATITUDE? Enter latitude In degrees, minutes, seconds, and porth or pouth 

ARRIVAL OAY OF YEAR? Enter arrival day of year (1 - 366) 

ARRIVAL TIME OF OAY? Enter arrival time of day (0 - 2400) 

Ship Control System 

STATUS? *es 

no 

HEADING? Enter ship's 

SPEED? Enter ship's 


Propulsion System 



STATUS? 

yes 

requests propulsion system status 


no 

no or CR selects next prompt 

FUEL TYPE? 

1.2,3 

Selects the fuel type 


requests ship control system status 
no or CR selects next prompt 

heading in degrees (0 - 360) 

speed in knots 


Explanation 


Selects the navigation system. 
Selects the ship control system. 
Selects the propulsion system. 
Selects the radar system. 

Selects the fire control system. 
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Propulsion System (cont.) 

FUEL RATE? Enter fuel flow rate In K6 per hr. (100 - 600) 

BOILER PRESSURE? Enter boiler pressure In PSI (50 « 250) 


Radar System 



STATUS? 

/es 

no 

requests radar system status 
no or CR selects the next prompt 

MODE? 

scan 

track 

Selects operating mode 

BEAM WIDTH? 

yarrow 

medium 

wide 

Selects scan beam width (scan mode only) 
Bypass for track mode. 

DIRECTION? 

Enter target direction In degrees (0 - 360) (track mode only) 

Bypass for scan mode. 

MTI? 

on 

off 

Controls moving target indicator 
(scan mode only) bypass for track mode. 

RANGE? 

Enter range In KM 
(5 - 100) 

Range scale for scan mode. 
Acquisition range for track mode. 

PULSE RATE? 

Enter pulse rate 
In PPS (50 - 1000) 


POWER LEVEL? 

Enter power level In 
KW (1,5,10) 

Transmitter output power level. 

Fire Control Systei 

m 


WEAPONS? 

Jtorpedo 
Cannon 
machine gun 
5epth charge 

Selects the torpedo system 
Selects the cannon system 
Selects the machine gun system 
Selects the depth charge systfem 

* Torpedo system 



STATUS? 

JteS 

no 

requests the torpedo system status, 
no or CR selects the next prompt. 

TUBE NO.? 

Enter the tube number 

Selects the torpedo tube number to 
be used (1 - 4). 

WARHEAD? 

HE 

W 

Selects either the high explosive 
or armor piercing warhead. 
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Torpedo system (cont.) 
RANGE? Enter 

SPEEO? Enter 

DEPTH? Enter 


range to target In meters, 
torpedo running speed In knots, 
torpedo running depth In meters. 


* Cannon system 


STATUS? 

GUN NO.? 
SIZE? 


yes requests cannon system status, 

no no or CR selects next prompt. 

Enter gun platform number (1 - 6). 

20 gun size selected either 20 mm or 125 nm. 

125 


TARGET ALTITUDE? 
TARGET DIRECTION? 
RANGE? 

NUMBER OF ROUNDS? 
WARHEAD? 


Enter target altitude in meters (20 mm gun only). 

Enter target direction in degrees (0 - 360). 

Enter target range in meters. 

Enter number of rounds to be fired. 

HE Select warhead, eith high explosive, 

W armor piercing, or shrapnel. 

SP 


* Machine gun system 


STATUS? 

yes 

requests machine gun status 


no or CR 

selects next prompt. 

CEASE FIRE? 

yes 

cease firing on all machine guns 



selects next prompt. 

MACHINE GUN PLATFORM? Enter machine gun 

number (1-20 or all ) 

SIZE? 

30 

.30 caliber 


1° 

.50 caliber 

DIRECTION? 

Enter target direction 

in degrees (0-360) 
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* Depth Charge system 


STATUS? *es 

no 


requests machine gun system status, 
no or CR selects the next prompt. 


NUMBER OF DEPTH CHARGES? 


Enter the number of depth charges to be dropped In 
the pattern. 


SIZE? 


100 

75U 


TO 


Size of the depth charges to be 
dropped In KG. 


INTERVAL? Enter the Interval between depth charge drops In seconds. 

DEPTH? Enter the firing depth In meters. 
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Mtnu Cownand Format 


•sYSTEm SELECT* « 

•I.* NAV sYSTeM", 

•2. SHIT CONTROL SYSTEM*, 

•3. TNorULSlUN CONTROL sYsTEM" 
•4. RAUAH CONTROL sYsTEm* 

•». FI HE CONTROL sYSTEm" 

*6. TERMINATE HEOUtaTS" 


•AAV nEJUEST* . 

*1. NEn nEUUEST" 

•2. STATUS". 

■3. LAST MtNU* - . 

•*. SfsTeM MENJ" . 

"ENTER LONG IT JOE • 

•fcflicM LATITUDE * 

•fcNTeH AkhIVaL DA* Ur YeAN ", 
•ENTER ARRIVAL TIMt Or QA* 

•THE NAV IGATloH sYsTEM IS G«e2N", 


•sH IT CONTROL* , 

*1. HEADING 4 STEED" 

•2. HEADING UNLY*.' 

•3. STEED ONLY", 

*4. STATUS* , 

•5. LAST MENU" . 

*6. SYSTEM MENU" 

•ENTER HEADING" 

•ENTER STEED *. 

•THE SHIP CONTNUL SYSTEM IS GREEN* 

•PROPULSION CUNTHOL", 

•I, PROPULSION SYSTE* SET UT", 

•2. FUtL HATE & BOILER PkESsURE ONLY" 

•3. STATUS", 

•4. LAST MENU- . 

•5. SYSTEM MENU", 

■THE * PROPULSION SYSTEM STATUS IS GREEN" 


■FUEL TYPE* , 


•1. 

BUNKER FUEL #1* 

•2. 

BUNKER FUEL *2" 

•Jm 

BUNAEH f UtL #3" 

*4. 

LAST MENU", 


SYSTEM MENU* 

•FUEL HATE* 

*1. 

t 00 KG TEH HH" 

•2. 

2oU KG PER HR" 

*3. 

3UU KG TEH HR" 

*4. 

400 KG PEN HH" 

■5. 

500 KG TEH HH" 

•4. 

400 KG PEH HH* 

•7. 

LAST MENU* 

•8. 

SYSTEM MENU" «, 

•BOILEH THESSUKE" 

•1. 

SO TSl" 

*2. 

IOO TSl" 

•3. 

ISO TSl" 

•4. 

200 PSI" 

*3. 

ksu TSl - 

*0. 

LAST menu* . 

•7. 

SYSTEM MtNU" 
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•MADAM CUMTNUL* 

a l* SET U*» Ne« 'MADAM MUUt" 

•*» MO MEM LEVEL ONLY" 

• 4 * STATUS"* 1 * ^ MOMfiM LEVEL ONLY" 

•5. LAST MENU* 

•d. SYSTEM MENU" 

•mauam system Is c*een« 

•madam ‘mode CONTmOL" 

•I. SCAN" « 

•2. TmACa", 

•3. LAST mbmu". 

•4. SYSrEM MENU", 

•MADAM BEAM nIDIH CONTMOL* 

•I. MaMMOn", 

*4. MEDIUM" 

•3. HIDE*. 

■4. UST MEMO". 

■a. SYSTEM mcNU" 

■ENTEM MADAM MO INTI No DImECTKW" 


■mTI 

CONTMOL" 

*1. 

ON". 

•4. 

OFF", 

m J. 

LAST mENU" , 

•4. 

SYSTEM mcNO". 

•MADAM MANGE HEL£CTuh 

•1. 

5 EM- 

•2. 

IO EM" 


la EM" 

•4, 

2a em* 

•t>. 

SO EM*, 

*6s 

loo Em", 

•7. 

system menu* 

•MAOAM MULSE MATE" 

•1. 

50 MMS" 

"4. 

IDO MMS" 

"3. 

ISO NMS" 

•4. 

250 *VS" 

•5. 

aou mms" 

•6. 

1 DOO NFS" , 

•7. 

LAST MENU", 

•a. 

SYSTEM M6N0" 

•MADAM MOnEM LEVEL" 

•1. 

1 EM", 

•2. 

5 E«", 

■3. 

10 En*. . 

•4. 

LAST MENU" 
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•FIRE CONTROL". 

•SELECT WEAPONS SYSTEM" 
• I . TORPEDO" ♦ ' 

•2. CANNON". 

•3. MACHINE «<UN" 

• 4 . DEPTH CHARuE" 


•9. LAST MENU". 
•6. SYSTEM MENU" 


•ToMRbOO CONTROL" 

•I. FINE TORPEDO" 

•2. STATUS", 

•3. LAST MENU" 

•4. SYSTEM MENU" 

"TORPEUo SYSTEM IS GRttN" 

"SELECT TORPEUO TUBE*. 

"I. TUBE NO. I" 

"2. TUflt NO. 2" 

"3. TUBE NO. 3" 

•4. TUBE NO. 4" 

•S. LAST MENU" 

"0. SYSTEM MENU" 

•TORPtDO nARHeAU SELECT" 

•I. HIGH EXPLOSIVE" 

•2. ARMOR PleRClNG" 

•3. LAST MEMO" 

*4. SYSTEM McNU" 

■ENTER TARGET RANGE IN METERS'" 

"ENTER TORPEDO RUNNING SPEED IN KNOTS • 

•ENTER TORPEDO RUNNING DEPTH IN METERS-" 

•CANNON CONTROL". 

"I. FIRE CANNON" 

*2. CHANGt NARHEAD ONLY" 

*3. change Target only" 

*4. sfATUS", 

•s. LAsT MENU*- . 

*6. SYSTEM MeNU", 

"GUN PLATFORM SELECT". 


•1. 

GUN NO. I" 

•2. 

GUN NO. 2" 

•3. 

GUN NO. 3" 

•4. 

GUN NO. 4" 

•3. 

GUN NO. 9" 

" 6 . 

GUN NO. o" 

•/. 

ALL GUNS", 

"B. 

LAST MENU" 

•9. 

SYSTEM MENU" 

•GUN SIZE", 

•1. 

20 MM" 

•2. 

125 MM" 

•J. 

LAST MENU". 

M. 

SYSTEM MENU* 


■enter target ALTITuut " 

•ENTER TARGET DIRECTION-* 

•ENTER TARGET RANGE IN METERS-" 

"ENTER NUMBER OF ROUNUs 
"MARHEAO SELECT", 

■I. HIGH EXPLOSIVE" 

■2. ARMOR PIERCING" 

•3. SHRAPNEL". 

•4. LAST MENU" 

•5. SYSTEM MENU". 

"ALL CAJMUNS ARE GREEN" 


r_9* 


I 

* MACHINE GUN CONTROL" 

■I. PUt MACHINE OUN" 

■2. CHANCE TANU6T* 

•J. CEASE FINING" 

■4. STATUS" 

"5. LAST MENU". 

•A. SYSTEM MENU" 

"MACHINE OUN STATUS" 

•OUNS NU. J(.JO CAL) AND NO. 12 (.SO CAL)" 

* AME JAMMED" 

•ALL OTHEH OUNS ARE GREEN" 

•SELECT MACHINE GUNS (NU. I To NU. 20 UN ALL)*" 

•SEliCt MACHINE OUN SIZE(CALIBEN)" 

•I. .JO CAL" 

•2. .SO CAL" 

•J. LAST MENU" 

•4. SYSTEM MENU". 

•ENTER TARGET DIRECTION-" 

•ENTER TARGET RANGE IN METEMS-" . 


•DEPTH CHANCE CIMThoL" 

•i. UNDP DEPTH CHANCts" 

"2. DEPTH CHANCE SYSTEM STATUS" 
"J. LAST mEmU" 

"4. SYSTEM MENU" 


•THE DEPTH CHANGE SYSTEM IS GNEEN" 

"ENTEN NUMSEK UP DEPTH CHANGES • 

•SELECT DEPTH CHANCE SIZE" 

"I. IOO AC" 

"2. 2sO Ac" 

•J. see Ac" 

"SET TIME SEQUENCE (SECS)*" 

•SET OtPTH CHARGE DEPTH (METERS)-". 
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Semantic Differential Scales 
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APPENDIX E 




Nutter Sequence 

The following number sequences were used in the number sequence 

test. 


SEQUENCE 

NUMBER 

SEQUENCE 


NEXT 

NUMBER 

RULE 

1 . 

2, 4, 6, 8, 10, 


12 

(N+2) 

2. 

32, 16, 8, 4, 2, 


1 

(N/2) 

3. 

1, 3, 5, 7, 11, 


13 

(Next Prime number) 

4. 

2, 4, 7, 11, 16, 


22 

(N+(n*l) ) n is the position) 

5* 

2, 5, 10, 17, 26, 


37 

UH(tefl)) 

6. 

180, 175, 165, 150, 

130, 

105 

(N-(5n)) 

7. 

254, 252, 248, 240, 

224, 

192 

(N-2n) 

8* 

2, 4, 12, 48, 240, 


1440 

(N*(l*l)) 

9. 

3, 8, 27, 112, 565, 


3396 

( (N*m)*n) 

10. 

3, 8, 25, 100, 499, 


2992 

( (N*m)+(3-n) ) 


Sequence Nutters 2, 4, 5, 6, 7, &8 are taken from Lanth, S, Mathematical 


Games, Puzzles, k Fallacies , Anco Publishing Company, Inc. , 219 Park Ave. , 
South, N.Y., N.Y. 10003, 1977. 
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APPENDIX G 


Performance Plots 

. The following are plots of the performance time (seconds on the 
vertical ordinate) against specific experience (horizontal ordinate) specific 
experience is the nuvber of times that specific ccrmand was need. 

There is a plot for each experimental system by format. The upper 
curve is the ploted performance time and the lower curve is the think time. 

The formats are identified in the upper right of the plot* They 

are: 

SF1 - short form mnemonic one format (with functionally listed manual) 

SP2 - short form unemonic two format (with alphabetic listed manual) 

LF - long form imemonic format 
P - prompted gormat 
M - menu format 

The specific task or experimental system is listed in the upper 


right comer as follows: 

Ship 

- ship control system 

Prop 

- propulsion control system 

Radar 

- radar control system 

Nan 

- navigation system 

Cannon 

- cammon fire control system 

MG 

- machine gun fire control system 

DC 

- depht charge fire control system 

Tpd 

- torpedo fire control system 
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APPENDIX H 

Semantic Differential Questionnarie Results 

Following are the means for each format response for each semantic 
differential question. 

* indicates significant to the 5% level. 

SF1 - short form imeronic one (functional manual) 

SF2 - short form nnemonic two (alphabetic manual) 

IP - long form nnemonic 

P - Prompted 

M - Menu 

Oomb - the aggreate mean for all formats 
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APPENDIX I 

First Attempt Performance Times 


Following are comparisons of the First attempt performance times 
(seconds) for each format and each experimental system. 


SYSTEM/FORMAT 

Navigation 
Propulsion 
Ship Control 
Radar 
Cannon 
Machine Gun 
Depth Charge 
Torpedo 

Totals 


SF1 

SF2 

If 

P 

M 

157 

157 

99 

83 

77 

88 

99 

67 

52 

60 

48 

59 

37 

35 

39 

177 

190 

124 

82 

61 

121 

160 

87 

81 

77 

71 

89 

47 

60 

54 

51 

92 

40 

31 

36 

72 

79 

41 

33 

43 

“755“ 

“325“ 

”532” 

35T 

337“ 


Following are comparisons of the second attempt performance times 

(seconds) 


System/Format 

SF1 

SF2 

If 

P 

M 

Navigation 

107 

105 

85 

67 

72 

Propulsion 

68 

58 

32 

37 

37 

Ship Control 

26 

24 

24 

29 

32 

Radar 

103 

86 

99 

64 

61 

Cannon 

127 

158 

83 

82 

76 

Machine Gun 

66 

66 

45 

46 

46 

Depth Charge 

49 

53 

33 

37 

38 

Torpedo 

78 

70 

48 

38 

39 

Totals 

624 

620 

449 

400 

401 
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APPENDIX J 

Specific Guideline Recomnendatlons for 
DSN Software Development 


The following guidelines are offered for DSN Software Development* 
They attempt to accomodate the DSN operations envlroment and to offer specific 
recommendations for station software man computer Interface designs* These 
guidelines are presented with the fervent hope that they are not slavishly 
followed without understanding the underlying rationale* They are a good 
place to start the MCI design, but with adaptations to fit local requirements. 

1. Primary Comnand Format - the aggregate level of learning of the DSN Station 
Operations Is relatively high. They use the operations software everyday 
as an Internal part of their job. The mnemonic command structure Is 
appropriate for these operators. 

2. Secondary Command Formats - prompt command format should be used for the 
stations Initialization and configuration activity. This activity typi- 
cally requires multiple Inputs which must be entered In a specific sequence. 
A prompt format Insures that no command will be overlooked and that the 
sequence Is correct. Command sequences which control high risk activities 
such as manual spacecraft commanding should use the prompt format. Again, 
this reduces the potential for missing a command or entering a command 
out of sequence. Programs which are used Infrequently by the operators 
should use the prompt format. The prompt format Is appropriate here 
because of the operator's lower level of learning. 

3. Decision Span - this research Indicates that decision span Is one of the 
more Important parameters In MCI design. It Is recommended that the 
decision span at any one level of activity be limited to ten or less. If 
the Inherent decision span Is larger than ten some form of hierarchical 
structure or grouping Identifier such as first character codes (for exam- 
ple, TXX for a telemetry command) be used. 

4. Command Arguments - the number of command arguments should be limited to 
four or less. 

5. Character Lengths - the number of characters In either the mnemonic code 

or the arguments should be four or less. If an argument requires more 
that four characters. It should be broken up into 4 or less character 
groups with some logical delimiter (for example, time - 10:34:48). 

6. Delimiters - the delimiters between arguments and between the mnemonic 
code and the first argument should be a spare. Because the space Is 
the easiest character to type. 

7. Command Structure - the command structure should be functionally related 
to the activity that it Is controlling. For example, the order of the 
command arguments should be In the same order In which the operator 
thinks of the system parameters. 
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8* Manual * the operator's manual should list the commands In functional 
groupings to aid the operator's search activity* 

9* Standard Names - similar commands In different systems should have 

similar names. The same function should have the same names (for example, 
HALT for program termination). 


Summary 

1. Use Mnemonic Command Format for operational software. 

2. Use Prompt Comnand for: 

a. Initialization 

b. High risk commands 

c. Low useage programs 

3. The Decision Span should be 10 or less. 

4. The Argument List should be 4 or less. 

5. The number of characters should be 4 or less in any mnemonic or argument. 

6. Use the spare character as a delimiter. 

7. The Command Structure should be functionally related to the controlled 
activity. 

8. The Operator's Manual should be organized In a manner functionally 
consistent with the system. 

9. Standardize 
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